Both the primary and the old primary are getting a lot of these. They started a couple months back but have recently become a lot more frequent and over the last approx six hours all attempts have failed.
rsync: getaddrinfo: archive.trinitydesktop.net 873: Temporary failure in name resolution rsync error: error in socket IO (code 10) at clientserver.c(139) [Receiver=3.2.7]
I've tried a few times to reproduce them with dig but previously have been unsuccessful. Here is a successful reproduction of the failure using dig:
$ dig +trace -t any archive.trinitydesktop.org
; <<>> DiG 9.18.16-1~deb12u1-Debian <<>> +trace -t any archive.trinitydesktop.org ;; global options: +cmd . 513855 IN NS b.root-servers.net. . 513855 IN NS c.root-servers.net. . 513855 IN NS d.root-servers.net. . 513855 IN NS g.root-servers.net. . 513855 IN NS i.root-servers.net. . 513855 IN NS a.root-servers.net. . 513855 IN NS m.root-servers.net. . 513855 IN NS e.root-servers.net. . 513855 IN NS l.root-servers.net. . 513855 IN NS k.root-servers.net. . 513855 IN NS h.root-servers.net. . 513855 IN NS f.root-servers.net. . 513855 IN NS j.root-servers.net. ;; Received 851 bytes from 127.0.0.1#53(127.0.0.1) in 0 ms
org. 172800 IN NS a0.org.afilias-nst.info. org. 172800 IN NS a2.org.afilias-nst.info. org. 172800 IN NS b0.org.afilias-nst.org. org. 172800 IN NS b2.org.afilias-nst.org. org. 172800 IN NS c0.org.afilias-nst.info. org. 172800 IN NS d0.org.afilias-nst.org. org. 86400 IN DS 26974 8 2 4FEDE294C53F438A158C41D39489CD78A86BEB0D8A0AEAFF14745C0D 16E1DE32 org. 86400 IN RRSIG DS 8 1 86400 20230719170000 20230706160000 11019 . GFUV+ognT5Y46phU5xS8ja6oQIA0SNo+ezvusC1rZ1qRRXbiz/S7WPuY OLoR4+dV+059Z9FrhaD3VChcOjAtQkJsBA9lmFdbERzZN3eXVtZdS4Qw U85/0tmPnKD0eYGAfEwrSyNNS1TzjMws5R1GdMPmxH065XPp1eqp08M7 pJ7lextMkwOMkvSM3EeO4eZzEHA76+u4IPUfHXPp6IXVyZR7cT3R58TI /a4dZsC3kbzY9IgVKoRFPeMg0cIXxvCha2iS0Rt8UxjijE8DMQB0J93k 5r5gf5Yl/lBVrvvVn+GooKGXGRahbhGbK2LllCqEHZuMim2q8YZW0uju CWzzsw== ;; Received 792 bytes from 192.58.128.30#53(j.root-servers.net) in 20 ms
trinitydesktop.org. 3600 IN NS ns1.rptsys.com. trinitydesktop.org. 3600 IN NS ns2.rptsys.com. trinitydesktop.org. 3600 IN DS 61248 10 2 A7B8B96ED5B3E79975D8DE2E1F0AA4B3EB19E223652D3C6C9EEB1F08 0E6F7FAC trinitydesktop.org. 3600 IN DS 61248 10 1 6DDEE2E3E08F63DAEFBA3727EBFB0FC3476C357E trinitydesktop.org. 3600 IN RRSIG DS 8 2 3600 20230722152257 20230701142257 33825 org. RPoO3+TxUoK0bvlgUnDtDtkIJCJjOMoqfA4chVAE9vs3DrZpQox5SXQP 36J9HbR7MoDSxoBS6WG23AfFrMmhT64xE50YY0rVOLXZN/TEh+xPpV/3 GgOD1PznKsMhVFaL9sRu+jfTIyH4T817hALy4P99kdpz0Hz2SYMsopH/ lmE= ;; Received 348 bytes from 199.19.56.1#53(a0.org.afilias-nst.info) in 188 ms
trinitydesktop.org. 86400 IN SOA ns1.rptsys.com. kb9vqf.pearsoncomputing.net. 2023070600 28800 3600 2419200 86400 trinitydesktop.org. 86400 IN RRSIG SOA 10 2 86400 20230805123001 20230706123001 49352 trinitydesktop.org. a87gcAbIhNo1JPKzOFqDo+hAMDttdkeXc+QdFTr86wVnq2wzq1JbyfNJ 2ahDh/Tmygp4QXC+dZXbTyLe3Z7fqJt1DXaXueUzzPrAoZ/fA9XFgwHp y1BwsCSjjEVGjvW7NcSBIuBadQr9f8qbFjNjhK/sY1h7oBgxZM6Zt0iu x97AifisDnXtmvEUAmQ0R0IT0U3lspZku/LC6QLh24Pg84xC6vfdM95k 4qVguJ8hoPZyaQsye61qnpA7d6/vOVgJTCv4Mhn/U+d13wa2ncWY/B96 3/I96KV0aLNx66rT8wtxi/gW7I8YvjNhnSsre15eKlQCTrkOGVTbEho6 M4Woaw== 18N2QUN8GCH4VJFNGPRBAU31VK9TR553.trinitydesktop.org. 86400 IN NSEC3 1 1 10 BAF7643358C59CBF 29I8Q2H7J5DPBTRAJEOFM20GOOEM1I5M A NS SOA MX TXT RRSIG DNSKEY NSEC3PARAM 18N2QUN8GCH4VJFNGPRBAU31VK9TR553.trinitydesktop.org. 86400 IN RRSIG NSEC3 10 3 86400 20230805123001 20230706123001 49352 trinitydesktop.org. Lfw2eDJQX8ewQxUYDB0zjkP8hb7QLuNGpUejyWBBIsaVJhK7Yx2Cpgcu IvqFYoMuIuuI5LI352z4S5dOPEMcno31uvFYTgWgZZGWZ0T6ykPvMuB/ 4YDknUZhI+Y3EoWY8vZnAnk36G65zBBzIilkcjCl3/G34kY1upxwxy7H 9rYtHZ+W3umv6gcvpNhs6lZbk14rIPbi2sCWnh9PzCgseFMlEXaw00tq u1JaJ4lNZjIsEhryR2EdFjVf+LFNZeVUzUBjiv70zE6/qIrsZnBSgJ3D HPJdWdqiLXxunWatNrJJ9wYFPcuO2Khdw1FJM6OeKM2jv4Twfd7RbttA Pjqy9w== N7KV211739T3H6EVPS9DJRPIG177TULP.trinitydesktop.org. 86400 IN NSEC3 1 1 10 BAF7643358C59CBF P0SGO622HMGN0G8LCR8UPU8KI9GCAEC7 A RRSIG N7KV211739T3H6EVPS9DJRPIG177TULP.trinitydesktop.org. 86400 IN RRSIG NSEC3 10 3 86400 20230805123001 20230706123001 49352 trinitydesktop.org. oMQjHI6kI24lXbc2qBMInDbgmuqRIfRLZk5u3oq6D3sR1Xc7HLPGIoN+ kN2zLt1WoPMLGzVgOPl2/+LM/H1ODI5mdEajRkpy9Gol5JB3KsBRaec0 2xDvjzFsDnzq8wvMl6c4TwSwS38W3LyZpPsuQatrC1LmQ8Eemfma6hqO XMJJzK/rGcumEwJCpfvDn2sHIl6dwHlpnAvySsrlZVFWC6TEq2vrG816 yhW/6Lb+0DvLp/e8pdbR4GVotewDoRyGMOt9cL31YXDvdIFxLnruPBlt WTy7PzIqxoNHzCS6Vn+I74j3rvptO0sAael9nRQbsbV9dlSgSVDp1Wly rHVshg== 93KKHI1QT7IH1BFLF59NE9BQI6QO2CHL.trinitydesktop.org. 86400 IN NSEC3 1 1 10 BAF7643358C59CBF B4M0OS0M9S7V6LN09E5JC9471DUAV7IQ 93KKHI1QT7IH1BFLF59NE9BQI6QO2CHL.trinitydesktop.org. 86400 IN RRSIG NSEC3 10 3 86400 20230805123001 20230706123001 49352 trinitydesktop.org. d1BP1ExNoJHp1ZA+izPMW7/Gya1eq5V58uIG/dl5d9e/AcwUtbJOULxz vPEbGFzvmN0X4agafcifmsT5SEjlfi2ufk8EfHsgvwX0J+nJIYUrilve qFQk2OihhWF3gfhcArV0qn8Iwp2xAQDEab4FddyAaQ8VW1IfAwnqgtT0 CyEs+t9uGl2IZJwVqDX8gq0I7mU+j9tot6c1pCYnD4yjrSEAhMWNLEjh ZxLd6qJ8XedrxsLoD+x51aiDEW329BRh7nQcF8PXz+c7Z/Z3SFiQV/F4 XTVYC4W/iry2w/AyliwI2+H/0+ScUV7Z72BuTJBOxyz4AD5/uVfz2aaS cBlUGA== ;; Received 1638 bytes from 23.155.224.10#53(ns1.rptsys.com) in 80 ms
--Mike
On Friday 07 of July 2023 02:30:03 Mike Bird via tde-devels wrote:
Both the primary and the old primary are getting a lot of these. They started a couple months back but have recently become a lot more frequent and over the last approx six hours all attempts have failed.
rsync: getaddrinfo: archive.trinitydesktop.net 873: Temporary failure in name resolution rsync error: error in socket IO (code 10) at clientserver.c(139) [Receiver=3.2.7]
I've tried a few times to reproduce them with dig but previously have been unsuccessful. Here is a successful reproduction of the failure using dig:
$ dig +trace -t any archive.trinitydesktop.org
; <<>> DiG 9.18.16-1~deb12u1-Debian <<>> +trace -t any archive.trinitydesktop.org ;; global options: +cmd . 513855 IN NS b.root-servers.net. . 513855 IN NS c.root-servers.net. . 513855 IN NS d.root-servers.net. . 513855 IN NS g.root-servers.net. . 513855 IN NS i.root-servers.net. . 513855 IN NS a.root-servers.net. . 513855 IN NS m.root-servers.net. . 513855 IN NS e.root-servers.net. . 513855 IN NS l.root-servers.net. . 513855 IN NS k.root-servers.net. . 513855 IN NS h.root-servers.net. . 513855 IN NS f.root-servers.net. . 513855 IN NS j.root-servers.net. ;; Received 851 bytes from 127.0.0.1#53(127.0.0.1) in 0 ms
org. 172800 IN NS a0.org.afilias-nst.info. org. 172800 IN NS a2.org.afilias-nst.info. org. 172800 IN NS b0.org.afilias-nst.org. org. 172800 IN NS b2.org.afilias-nst.org. org. 172800 IN NS c0.org.afilias-nst.info. org. 172800 IN NS d0.org.afilias-nst.org. org. 86400 IN DS 26974 8 2 4FEDE294C53F438A158C41D39489CD78A86BEB0D8A0AEAFF14745C0D 16E1DE32 org. 86400 IN RRSIG DS 8 1 86400 20230719170000 20230706160000 11019 . GFUV+ognT5Y46phU5xS8ja6oQIA0SNo+ezvusC1rZ1qRRXbiz/S7WPuY OLoR4+dV+059Z9FrhaD3VChcOjAtQkJsBA9lmFdbERzZN3eXVtZdS4Qw U85/0tmPnKD0eYGAfEwrSyNNS1TzjMws5R1GdMPmxH065XPp1eqp08M7 pJ7lextMkwOMkvSM3EeO4eZzEHA76+u4IPUfHXPp6IXVyZR7cT3R58TI /a4dZsC3kbzY9IgVKoRFPeMg0cIXxvCha2iS0Rt8UxjijE8DMQB0J93k 5r5gf5Yl/lBVrvvVn+GooKGXGRahbhGbK2LllCqEHZuMim2q8YZW0uju CWzzsw== ;; Received 792 bytes from 192.58.128.30#53(j.root-servers.net) in 20 ms
trinitydesktop.org. 3600 IN NS ns1.rptsys.com. trinitydesktop.org. 3600 IN NS ns2.rptsys.com. trinitydesktop.org. 3600 IN DS 61248 10 2 A7B8B96ED5B3E79975D8DE2E1F0AA4B3EB19E223652D3C6C9EEB1F08 0E6F7FAC trinitydesktop.org. 3600 IN DS 61248 10 1 6DDEE2E3E08F63DAEFBA3727EBFB0FC3476C357E trinitydesktop.org. 3600 IN RRSIG DS 8 2 3600 20230722152257 20230701142257 33825 org. RPoO3+TxUoK0bvlgUnDtDtkIJCJjOMoqfA4chVAE9vs3DrZpQox5SXQP 36J9HbR7MoDSxoBS6WG23AfFrMmhT64xE50YY0rVOLXZN/TEh+xPpV/3 GgOD1PznKsMhVFaL9sRu+jfTIyH4T817hALy4P99kdpz0Hz2SYMsopH/ lmE= ;; Received 348 bytes from 199.19.56.1#53(a0.org.afilias-nst.info) in 188 ms
trinitydesktop.org. 86400 IN SOA ns1.rptsys.com. kb9vqf.pearsoncomputing.net. 2023070600 28800 3600 2419200 86400 trinitydesktop.org. 86400 IN RRSIG SOA 10 2 86400 20230805123001 20230706123001 49352 trinitydesktop.org. a87gcAbIhNo1JPKzOFqDo+hAMDttdkeXc+QdFTr86wVnq2wzq1JbyfNJ 2ahDh/Tmygp4QXC+dZXbTyLe3Z7fqJt1DXaXueUzzPrAoZ/fA9XFgwHp y1BwsCSjjEVGjvW7NcSBIuBadQr9f8qbFjNjhK/sY1h7oBgxZM6Zt0iu x97AifisDnXtmvEUAmQ0R0IT0U3lspZku/LC6QLh24Pg84xC6vfdM95k 4qVguJ8hoPZyaQsye61qnpA7d6/vOVgJTCv4Mhn/U+d13wa2ncWY/B96 3/I96KV0aLNx66rT8wtxi/gW7I8YvjNhnSsre15eKlQCTrkOGVTbEho6 M4Woaw== 18N2QUN8GCH4VJFNGPRBAU31VK9TR553.trinitydesktop.org. 86400 IN NSEC3 1 1 10 BAF7643358C59CBF 29I8Q2H7J5DPBTRAJEOFM20GOOEM1I5M A NS SOA MX TXT RRSIG DNSKEY NSEC3PARAM 18N2QUN8GCH4VJFNGPRBAU31VK9TR553.trinitydesktop.org. 86400 IN RRSIG NSEC3 10 3 86400 20230805123001 20230706123001 49352 trinitydesktop.org. Lfw2eDJQX8ewQxUYDB0zjkP8hb7QLuNGpUejyWBBIsaVJhK7Yx2Cpgcu IvqFYoMuIuuI5LI352z4S5dOPEMcno31uvFYTgWgZZGWZ0T6ykPvMuB/ 4YDknUZhI+Y3EoWY8vZnAnk36G65zBBzIilkcjCl3/G34kY1upxwxy7H 9rYtHZ+W3umv6gcvpNhs6lZbk14rIPbi2sCWnh9PzCgseFMlEXaw00tq u1JaJ4lNZjIsEhryR2EdFjVf+LFNZeVUzUBjiv70zE6/qIrsZnBSgJ3D HPJdWdqiLXxunWatNrJJ9wYFPcuO2Khdw1FJM6OeKM2jv4Twfd7RbttA Pjqy9w== N7KV211739T3H6EVPS9DJRPIG177TULP.trinitydesktop.org. 86400 IN NSEC3 1 1 10 BAF7643358C59CBF P0SGO622HMGN0G8LCR8UPU8KI9GCAEC7 A RRSIG N7KV211739T3H6EVPS9DJRPIG177TULP.trinitydesktop.org. 86400 IN RRSIG NSEC3 10 3 86400 20230805123001 20230706123001 49352 trinitydesktop.org. oMQjHI6kI24lXbc2qBMInDbgmuqRIfRLZk5u3oq6D3sR1Xc7HLPGIoN+ kN2zLt1WoPMLGzVgOPl2/+LM/H1ODI5mdEajRkpy9Gol5JB3KsBRaec0 2xDvjzFsDnzq8wvMl6c4TwSwS38W3LyZpPsuQatrC1LmQ8Eemfma6hqO XMJJzK/rGcumEwJCpfvDn2sHIl6dwHlpnAvySsrlZVFWC6TEq2vrG816 yhW/6Lb+0DvLp/e8pdbR4GVotewDoRyGMOt9cL31YXDvdIFxLnruPBlt WTy7PzIqxoNHzCS6Vn+I74j3rvptO0sAael9nRQbsbV9dlSgSVDp1Wly rHVshg== 93KKHI1QT7IH1BFLF59NE9BQI6QO2CHL.trinitydesktop.org. 86400 IN NSEC3 1 1 10 BAF7643358C59CBF B4M0OS0M9S7V6LN09E5JC9471DUAV7IQ 93KKHI1QT7IH1BFLF59NE9BQI6QO2CHL.trinitydesktop.org. 86400 IN RRSIG NSEC3 10 3 86400 20230805123001 20230706123001 49352 trinitydesktop.org. d1BP1ExNoJHp1ZA+izPMW7/Gya1eq5V58uIG/dl5d9e/AcwUtbJOULxz vPEbGFzvmN0X4agafcifmsT5SEjlfi2ufk8EfHsgvwX0J+nJIYUrilve qFQk2OihhWF3gfhcArV0qn8Iwp2xAQDEab4FddyAaQ8VW1IfAwnqgtT0 CyEs+t9uGl2IZJwVqDX8gq0I7mU+j9tot6c1pCYnD4yjrSEAhMWNLEjh ZxLd6qJ8XedrxsLoD+x51aiDEW329BRh7nQcF8PXz+c7Z/Z3SFiQV/F4 XTVYC4W/iry2w/AyliwI2+H/0+ScUV7Z72BuTJBOxyz4AD5/uVfz2aaS cBlUGA== ;; Received 1638 bytes from 23.155.224.10#53(ns1.rptsys.com) in 80 ms
--Mike ____________________________________________________
Hi Mike,
the name "archive" is only on the domain trinitydesktop.net. I have verified resolving now and all seems to be fine. In the syslog I see access to the rsync from your servers. I can't say whether there was a problem with a DNS provider or something else.
Cheers
On Fri July 7 2023 00:59:23 Slávek Banko via tde-devels wrote:
the name "archive" is only on the domain trinitydesktop.net. I have verified resolving now and all seems to be fine. In the syslog I see access to the rsync from your servers. I can't say whether there was a problem with a DNS provider or something else.
Hi Slávek,
Thank you for noticing that when I used 'dig' I used the wrong TLD.
However two different servers each had three consecutive DNS lookup failures for archive.trinitydesktop.net over a period of several hours and there have been failures several times per day over the last couple of months.
Nevertheless it has been working fine for the last eight hours so I guess I'll just keep an eye on it for now.
--Mike
On Fri July 7 2023 02:07:00 Mike Bird via tde-devels wrote:
Nevertheless it has been working fine for the last eight hours so I guess I'll just keep an eye on it for now.
Approx half an hour ago when old and new primaries tried to pull:
Fri Jul 7 06:28:24 PM PDT 2023 on 104.161.79.151 rsync: getaddrinfo: archive.trinitydesktop.net 873: No address associated with hostname rsync error: error in socket IO (code 10) at clientserver.c(139) [Receiver=3.2.7]
Fri Jul 7 06:37:19 PM PDT 2023 on 173.249.206.25 rsync: getaddrinfo: archive.trinitydesktop.net 873: No address associated with hostname rsync error: error in socket IO (code 10) at clientserver.c(139) [Receiver=3.2.7]
These two servers are both in USA but other than that have little in common being 15 hops apart so I don't think it's a network problem.
OTOH I have never been able to replicate this with dig so maybe I've configured something wrong on these servers? But then I also use rsync to pull from non-TDE mirrors without seeing problems like this.
--Mike
Are you connecting over UDP or TCP? I'm suspecting one of the upstream carriers to the datacenter hosting the DNS may be dropping UDP packets on certain routes -- if so, doing a traceroute from both locations and sending it over may help escalate the issue. Are you seeing the same problem on both DNS servers (ns1 and ns2)? They are on different physical hosts on different subnets with different routing.
Thanks!
----- Original Message ----- From: "Mike Bird via tde-devels" devels@trinitydesktop.org To: devels@trinitydesktop.org Cc: "Mike Bird" mgb-trinity@yosemite.net Sent: Friday, July 7, 2023 9:06:54 PM Subject: [tde-devels] Re: TDE DNS problem
On Fri July 7 2023 02:07:00 Mike Bird via tde-devels wrote:
Nevertheless it has been working fine for the last eight hours so I guess I'll just keep an eye on it for now.
Approx half an hour ago when old and new primaries tried to pull:
Fri Jul 7 06:28:24 PM PDT 2023 on 104.161.79.151 rsync: getaddrinfo: archive.trinitydesktop.net 873: No address associated with hostname rsync error: error in socket IO (code 10) at clientserver.c(139) [Receiver=3.2.7]
Fri Jul 7 06:37:19 PM PDT 2023 on 173.249.206.25 rsync: getaddrinfo: archive.trinitydesktop.net 873: No address associated with hostname rsync error: error in socket IO (code 10) at clientserver.c(139) [Receiver=3.2.7]
These two servers are both in USA but other than that have little in common being 15 hops apart so I don't think it's a network problem.
OTOH I have never been able to replicate this with dig so maybe I've configured something wrong on these servers? But then I also use rsync to pull from non-TDE mirrors without seeing problems like this.
--Mike ____________________________________________________ tde-devels mailing list -- devels@trinitydesktop.org To unsubscribe send an email to devels-leave@trinitydesktop.org Web mail archive available at https://mail.trinitydesktop.org/mailman3/hyperkitty/list/devels@trinitydeskt...
On Sun July 9 2023 10:49:10 Timothy Pearson via tde-devels wrote:
Are you connecting over UDP or TCP? I'm suspecting one of the upstream carriers to the datacenter hosting the DNS may be dropping UDP packets on certain routes -- if so, doing a traceroute from both locations and sending it over may help escalate the issue. Are you seeing the same problem on both DNS servers (ns1 and ns2)? They are on different physical hosts on different subnets with different routing.
Hi Tim,
The problem is happening with DNS lookups of archive.trinitydesktop.net which relates to DNS servers ns1.websupport.cz, ns2.websupport.cz, and ns3.websupport.eu.
I get fairly frequent DNS lookup timeouts from rsync on two USA servers which are 15 hops apart but as yet have been unable to replicate the problem with dig. It may be a more basic networking flakiness between USA and CZ but it's hard to diagnose because traceroutes to ns1.websupport.cz routinely fail even while pings succeed - presumably because of some unhelpful excessive firewalling.
I have not noticed any problems with your ns1.rptsys.com and ns2.rptsys.com providing DNS for trinitydesktop.org.
Hope all is well with you!
--Mike
FWIW the intermittent problem I was experiencing with TDE DNS was mine.
We only use ipv4. We therefore had "-4" in /etc/default/bind9.
Probably during the latest Debian upgrade the appropriate file had become /etc/default/named but I had not added "-4" in /etc/default/named.
Fixed here now. Sorry for the noise.
--Mike
-
Mike Bird -
Slávek Banko -
Timothy Pearson