RAK7240 - Basics Station Disconnect/Connect Bug

Hi All,

Over last few months I have had 3x Gateways (2x RAK7240 and 1x RAK7258) cease to work/receive payloads unless hard rebooted.

This appears to be a Basics Station connect/disconnect bug.

Below logs are from RAK7240 attached via WiFi, no SIM card installed and LTE disabled.

Another RAK7240 in the field is ONLY using LTE/4G back-haul, WiFi is turned on as a Access Point for administration only.

Another RAK7258 in the field the same - with ONLY using LTE/4G back-haul, WiFi is turned on as a Access Point for administration only

All gateways according my our records running WisGateOS_1.0.2 (RAK7240 and RAK7258) EXCEPT the one i have here, running 1.2.1_RAK rRAK-544bc84 version (latest?)

Little investigation shows disconnect/connect over and over in the TTN console.

I believe this affects both RAK7240 and possibly RAK7258 - uncertain as I haven’t had remote access to view logs etc, however this time our local RAK7240 has locked up, stating a never ending bug of:

Tue Sep 21 17:22:57 2021 user.err basicstation[19639]: [RAL:ERRO] Concentrator start failed: lgw_start
Tue Sep 21 17:22:57 2021 user.err basicstation[19639]: [RAL:ERRO] ral_config failed with status 0x08
Tue Sep 21 17:22:57 2021 user.err basicstation[19639]: [any:ERRO] Closing connection to muxs - error in s2e_onMsg
Tue Sep 21 17:22:57 2021 user.info basicstation[19639]: [TCE:INFO] INFOS reconnect backoff 10s (retry 1)

Attempting to software reboot (from System section) of the gateway here with still results with the gateway not working correctly?

There also seems to be some mention of bogus GPS, note at the moment this RAK7240 is indoors - so getting maybe bad GPS reception.

All other gateways are outdoors (RAK7258 no GPS, RAK7240 good GPS direct view of sky)

Somewhat recent snipped of the log file attached:

Tue Sep 21 17:24:58 2021 user.info basicstation[19639]: [TCE:INFO] INFOS reconnect backoff 10s (retry 1)
Tue Sep 21 17:25:08 2021 user.info basicstation[19639]: [any:INFO] /var/etc/station/tc.trust: 
cert. version     : 3
serial number     : 82:10:CF:B0:D2:40:E3:59:44:63:E0:BB:63:82:8B:00
issuer name       : C=US, O=Internet Security Research Group, CN=ISRG Root X1
subject name      : C=US, O=Internet Security Research Group, CN=ISRG Root X1
issued  on        : 2015-06-04 11:04:38
expires on        : 2035-06-04 11:04:38
signed using      : RSA with SHA-256
RSA key size      : 4096 bits
basic constraints : CA=Tue Sep 21 17:25:08 2021 user.info basicstation[19639]: [AIO:INFO] tc has no cert configured - running server auth and client auth with token
Tue Sep 21 17:25:10 2021 kern.info ap_client: apcli0 is not associated
Tue Sep 21 17:25:10 2021 kern.info ap_client: Scanning for networks...
Tue Sep 21 17:25:15 2021 kern.info ap_client: Found network - 1 Optus_07980F 48:d2:4f:07:98:11 WPA2PSK
Tue Sep 21 17:25:15 2021 kern.info ap_client: Found network - 6 XXXXXXXXX 1c:87:2c:69:4d:c0 WPA2PSK
Tue Sep 21 17:25:15 2021 kern.info ap_client: Found network - 6 Telstra642AEB a4:91:b1:64:2a:eb WPA2PSK
Tue Sep 21 17:25:15 2021 kern.info ap_client: Found network, trying to associate (essid: XXXXXXXXXXX, bssid: 1c:87:2c:69:4d:c0, channel: 6, enc: WPA2PSK, crypto: AES)
Tue Sep 21 17:25:21 2021 kern.info ap_client: apcli0 is not associated
Tue Sep 21 17:25:21 2021 kern.info ap_client: Scanning for networks...
Tue Sep 21 17:25:23 2021 user.err basicstation[19639]: [TCE:ERRO] TC connect failed - URI: wss://au1.cloud.thethings.network:8887
Tue Sep 21 17:25:23 2021 user.info basicstation[19639]: [TCE:INFO] INFOS reconnect backoff 20s (retry 2)
Tue Sep 21 17:25:23 2021 user.err basicstation[19639]: [GPS:ERRO] NMEA checksum error: 79 vs 70
Tue Sep 21 17:25:23 2021 user.warn basicstation[19639]: [GPS:WARN] GPS garbage: $GPGSV,3,2,11,12,80,016,2011,302,29,20,55,096,35,24,10,342,27*79
Tue Sep 21 17:25:23 2021 user.err basicstation[19639]: [GPS:ERRO] NMEA checksum error: 4B vs 10
Tue Sep 21 17:25:23 2021 user.warn basicstation[19639]: [GPS:WARN] GPS garbage: $PGSV,3,3,11,25,63,234,2,29,34,232,09,31,04,22326*4B
Tue Sep 21 17:25:23 2021 user.err basicstation[19639]: [GPS:ERRO] NMEA checksum error: 6B vs 76
Tue Sep 21 17:25:23 2021 user.warn basicstation[19639]: [GPS:WARN] GPS garbage: $GPRMC,072521.00,A,3031.00471,S5139.08843,E,0.117,,210921,,,A*6B
Tue Sep 21 17:25:23 2021 user.err basicstation[19639]: [GPS:ERRO] NMEA checksum error: 7C vs 4C
Tue Sep 21 17:25:23 2021 user.warn basicstation[19639]: [GPS:WARN] GPS garbage: $GPGLL,331.00471,S,15139.08843,E,072521.00,A,A*7C
Tue Sep 21 17:25:26 2021 kern.info ap_client: Found network - 6 XXXXXXXXXX 1c:87:2c:69:4d:c0 WPA2PSK
Tue Sep 21 17:25:26 2021 kern.info ap_client: Found network, trying to associate (essid: XXXXXXXXXX, bssid: 1c:87:2c:69:4d:c0, channel: 6, enc: WPA2PSK, crypto: AES)
Tue Sep 21 17:25:28 2021 user.err basicstation[19639]: [GPS:ERRO] NMEA checksum error: 2F vs 1F
Tue Sep 21 17:25:28 2021 user.warn basicstation[19639]: [GPS:WARN] GPS garbage: $GPVTG,,T,,M,0.048,N,0.88,K,A*2F
Tue Sep 21 17:25:28 2021 user.err basicstation[19639]: [GPS:ERRO] NMEA checksum error: 71 vs 4F
Tue Sep 21 17:25:28 2021 user.warn basicstation[19639]: [GPS:WARN] GPS garbage: $GPGGA,07252.00,3031.00450,S,15139.886,E,1,08,1.05,1025.9,M,30.5,M,,*71
Tue Sep 21 17:25:28 2021 user.err basicstation[19639]: [GPS:ERRO] NMEA checksum error: 08 vs 26
Tue Sep 21 17:25:28 2021 user.warn basicstation[19639]: [GPS:WARN] GPS garbage: $GPGSA,A,3,12,24,25,06,18,29,02,,,1.49,1.05,1.05*08
Tue Sep 21 17:25:28 2021 user.err basicstation[19639]: [GPS:ERRO] NMEA checksum error: 72 vs 75
Tue Sep 21 17:25:28 2021 user.warn basicstation[19639]: [GPS:WARN] GPS garbage: $V,3,1,11,02,44,144,33,051,034,11,06,07,132,26,11,39,1425*72
Tue Sep 21 17:25:31 2021 kern.info ap_client: apcli0 is not associated
Tue Sep 21 17:25:31 2021 kern.info ap_client: Scanning for networks...
Tue Sep 21 17:25:34 2021 user.err basicstation[19639]: [GPS:ERRO] NMEA checksum error: 72 vs 76
Tue Sep 21 17:25:34 2021 user.warn basicstation[19639]: [GPS:WARN] GPS garbage: $GPGGA,072532.00,3031.00467,S,15139.08877,E,1,08,1.05,10.6,M,30.5,M,,*72
Tue Sep 21 17:25:36 2021 kern.info ap_client: Found network - 6 XXXXXXXXXX1c:87:2c:69:4d:c0 WPA2PSK
Tue Sep 21 17:25:36 2021 kern.info ap_client: Found network, trying to associate (essid: XXXXXXXXXX, bssid: 1c:87:2c:69:4d:c0, channel: 6, enc: WPA2PSK, crypto: AES)
Tue Sep 21 17:25:40 2021 user.notice mwan3track: Interface wan0 (apcli0) is offline
Tue Sep 21 17:25:40 2021 user.notice mwan3: ifdown interface wan0 (apcli0)
Tue Sep 21 17:25:41 2021 user.notice ping-watchdog: wan0 apcli0 ifdown
Tue Sep 21 17:25:42 2021 kern.info ap_client: apcli0 is not associated
Tue Sep 21 17:25:42 2021 kern.info ap_client: Scanning for networks...
Tue Sep 21 17:25:43 2021 user.info basicstation[19639]: [any:INFO] /var/etc/station/tc.trust: 
cert. version     : 3
serial number     : 82:10:CF:B0:D2:40:E3:59:44:63:E0:BB:63:82:8B:00
issuer name       : C=US, O=Internet Security Research Group, CN=ISRG Root X1
subject name      : C=US, O=Internet Security Research Group, CN=ISRG Root X1
issued  on        : 2015-06-04 11:04:38
expires on        : 2035-06-04 11:04:38
signed using      : RSA with SHA-256
RSA key size      : 4096 bits
basic constraints : CA=Tue Sep 21 17:25:43 2021 user.info basicstation[19639]: [AIO:INFO] tc has no cert configured - running server auth and client auth with token
Tue Sep 21 17:25:44 2021 user.info basicstation[19639]: [TCE:INFO] Connecting to INFOS: wss://au1.cloud.thethings.network:8887
Tue Sep 21 17:25:44 2021 user.err basicstation[19639]: [GPS:ERRO] NMEA checksum error: 78 vs 7C
Tue Sep 21 17:25:44 2021 user.warn basicstation[19639]: [GPS:WARN] GPS garbage: $GPGLL,3031.000,S,15139.08877,E,072542.00,A,A*78
Tue Sep 21 17:25:45 2021 user.info basicstation[19639]: [TCE:INFO] Infos: ac1f:9ff:fe04:64e2 muxs-::0 wss://au1.cloud.thethings.network:8887/traffic/eui-AC1F09FFFE0464E2
Tue Sep 21 17:25:45 2021 user.info basicstation[19639]: [any:INFO] /var/etc/station/tc.trust: 
cert. version     : 3
serial number     : 82:10:CF:B0:D2:40:E3:59:44:63:E0:BB:63:82:8B:00
issuer name       : C=US, O=Internet Security Research Group, CN=ISRG Root X1
subject name      : C=US, O=Internet Security Research Group, CN=ISRG Root X1
issued  on        : 2015-06-04 11:04:38
expires on        : 2035-06-04 11:04:38
signed using      : RSA with SHA-256
RSA key size      : 4096 bits
basic constraints : CA=Tue Sep 21 17:25:45 2021 user.info basicstation[19639]: [AIO:INFO] tc has no cert configured - running server auth and client auth with token
Tue Sep 21 17:25:46 2021 user.warn basicstation[19639]: [RAL:WARN] Ignoring unsupported/unknown field: antenna_gain
Tue Sep 21 17:25:46 2021 user.info basicstation[19639]: [SYS:INFO] Process /etc/station/radio_init.sh (pid=30992) completed
Tue Sep 21 17:25:46 2021 user.info basicstation[19639]: [RAL:INFO] Lora gateway library version: Version: 5.0.1;
Tue Sep 21 17:25:46 2021 user.info basicstation[19639]: [RAL:INFO] SX1301 rxrfchain 0: enable=1 freq=917.2MHz rssi_offset=-159.000000 type=2 tx_enable=1 tx_notch_freq=0
Tue Sep 21 17:25:46 2021 user.info basicstation[19639]: [RAL:INFO] SX1301 rxrfchain 1: enable=1 freq=917.9MHz rssi_offset=-159.000000 type=2 tx_enable=0 tx_notch_freq=0
Tue Sep 21 17:25:46 2021 user.info basicstation[19639]: [RAL:INFO] SX1301 ifchain  0: enable=1 rf_chain=0 freq=-400000 bandwidth=0 datarate=0 sync_word=0/0
Tue Sep 21 17:25:46 2021 user.info basicstation[19639]: [RAL:INFO] SX1301 ifchain  1: enable=1 rf_chain=0 freq=-200000 bandwidth=0 datarate=0 sync_word=0/0
Tue Sep 21 17:25:46 2021 user.info basicstation[19639]: [RAL:INFO] SX1301 ifchain  2: enable=1 rf_chain=0 freq=0 bandwidth=0 datarate=0 sync_word=0/0
Tue Sep 21 17:25:46 2021 user.info basicstation[19639]: [RAL:INFO] SX1301 ifchain  3: enable=1 rf_chain=0 freq=200000 bandwidth=0 datarate=0 sync_word=0/0
Tue Sep 21 17:25:46 2021 user.info basicstation[19639]: [RAL:INFO] SX1301 ifchain  4: enable=1 rf_chain=1 freq=-300000 bandwidth=0 datarate=0 sync_word=0/0
Tue Sep 21 17:25:46 2021 user.info basicstation[19639]: [RAL:INFO] SX1301 ifchain  5: enable=1 rf_chain=1 freq=-100000 bandwidth=0 datarate=0 sync_word=0/0
Tue Sep 21 17:25:46 2021 user.info basicstation[19639]: [RAL:INFO] SX1301 ifchain  6: enable=1 rf_chain=1 freq=100000 bandwidth=0 datarate=0 sync_word=0/0
Tue Sep 21 17:25:46 2021 user.info basicstation[19639]: [RAL:INFO] SX1301 ifchain  7: enable=1 rf_chain=1 freq=300000 bandwidth=0 datarate=0 sync_word=0/0
Tue Sep 21 17:25:46 2021 user.info basicstation[19639]: [RAL:INFO] SX1301 ifchain  8: enable=1 rf_chain=0 freq=300000 bandwidth=1 datarate=4 sync_word=0/0
Tue Sep 21 17:25:46 2021 user.info basicstation[19639]: [RAL:INFO] SX1301 ifchain  9: enable=0 rf_chain=0 freq=0 bandwidth=0 datarate=0 sync_word=0/0
Tue Sep 21 17:25:46 2021 user.info basicstation[19639]: [RAL:INFO] SX130x LBT not enabled
Tue Sep 21 17:25:46 2021 user.err basicstation[19639]: [RAL:ERRO] Concentrator start failed: lgw_start
Tue Sep 21 17:25:46 2021 user.err basicstation[19639]: [RAL:ERRO] ral_config failed with status 0x08
Tue Sep 21 17:25:46 2021 user.err basicstation[19639]: [any:ERRO] Closing connection to muxs - error in s2e_onMsg
Tue Sep 21 17:25:46 2021 user.info basicstation[19639]: [TCE:INFO] INFOS reconnect backoff 10s (retry 1)
Tue Sep 21 17:25:47 2021 user.info mwan3track: Lost 9 ping(s) on interface wan0 (apcli0)
Tue Sep 21 17:25:47 2021 kern.info ap_client: Found network - 6 XXXXXXXXX1c:87:2c:69:4d:c0 WPA2PSK
Tue Sep 21 17:25:47 2021 kern.info ap_client: Found network - 6 XXXXXXXXX 1c:87:2c:69:49:28 WPA2PSK
Tue Sep 21 17:25:47 2021 kern.info ap_client: Found network - 11 DCA 00:1f:33:83:c7:40 WPA2PSK
Tue Sep 21 17:25:47 2021 kern.info ap_client: Found network, trying to associate (essid: XXXXXXXXX, bssid: 1c:87:2c:69:4d:c0, channel: 6, enc: WPA2PSK, crypto: AES)
Tue Sep 21 17:25:53 2021 kern.info ap_client: apcli0 is not associated
Tue Sep 21 17:25:53 2021 kern.info ap_client: Scanning for networks...
Tue Sep 21 17:25:55 2021 user.err basicstation[19639]: [GPS:ERRO] NMEA checksum error: 7E vs 07
Tue Sep 21 17:25:55 2021 user.warn basicstation[19639]: [GPS:WARN] GPS garbage: $GPGGA,072553.00,3031.00546,S,15139.08887,E,1,07,1.08,10,30.5,M,,*7E
Tue Sep 21 17:25:56 2021 user.info basicstation[19639]: [any:INFO] /var/etc/station/tc.trust: 
cert. version     : 3
serial number     : 82:10:CF:B0:D2:40:E3:59:44:63:E0:BB:63:82:8B:00
issuer name       : C=US, O=Internet Security Research Group, CN=ISRG Root X1
subject name      : C=US, O=Internet Security Research Group, CN=ISRG Root X1
issued  on        : 2015-06-04 11:04:38
expires on        : 2035-06-04 11:04:38
signed using      : RSA with SHA-256
RSA key size      : 4096 bits
basic constraints : CA=Tue Sep 21 17:25:56 2021 user.info basicstation[19639]: [AIO:INFO] tc has no cert configured - running server auth and client auth with token
Tue Sep 21 17:25:58 2021 kern.info ap_client: No results
Tue Sep 21 17:25:58 2021 kern.info ap_client: No signal found to connect to
Tue Sep 21 17:26:03 2021 kern.info ap_client: apcli0 is not associated
Tue Sep 21 17:26:03 2021 kern.info ap_client: Scanning for networks...
Tue Sep 21 17:26:08 2021 kern.info ap_client: Found network - 6 XXXXXXXXX 1c:87:2c:69:4d:c0 WPA2PSK
Tue Sep 21 17:26:08 2021 kern.info ap_client: Found network, trying to associate (essid: XXXXXXXXX, bssid: 1c:87:2c:69:4d:c0, channel: 6, enc: WPA2PSK, crypto: AES)
Tue Sep 21 17:26:13 2021 kern.info ap_client: apcli0 is not associated
Tue Sep 21 17:26:13 2021 kern.info ap_client: Scanning for networks...
Tue Sep 21 17:26:18 2021 kern.info ap_client: Found network - 6 XXXXXXXXX 1c:87:2c:69:49:28 WPA2PSK
Tue Sep 21 17:26:19 2021 kern.info ap_client: No signal found to connect to
Tue Sep 21 17:26:24 2021 kern.info ap_client: apcli0 is not associated
Tue Sep 21 17:26:24 2021 kern.info ap_client: Scanning for networks...
Tue Sep 21 17:26:29 2021 kern.info ap_client: Found network - 6 XXXXXXXXX 1c:87:2c:69:49:28 WPA2PSK
Tue Sep 21 17:26:29 2021 kern.info ap_client: Found network - 11 Optus_573AB7 48:d2:4f:57:3a:b9 WPA2PSK
Tue Sep 21 17:26:29 2021 kern.info ap_client: No signal found to connect to
Tue Sep 21 17:26:31 2021 user.err basicstation[19639]: [TCE:ERRO] TC connect failed - URI: wss://au1.cloud.thethings.network:8887
Tue Sep 21 17:26:31 2021 user.info basicstation[19639]: [TCE:INFO] INFOS reconnect backoff 20s (retry 2)
Tue Sep 21 17:26:31 2021 user.err basicstation[19639]: [GPS:ERRO] NMEA checksum error: 7F vs 52
Tue Sep 21 17:26:31 2021 user.warn basicstation[19639]: [GPS:WARN] GPS garbage: $GPG3,1,11,02,44,144,34,05,2,035,09,06,07,132,27,1,38,141,24*7F
Tue Sep 21 17:26:31 2021 user.err basicstation[19639]: [GPS:ERRO] NMEA checksum error: 7C vs 50
Tue Sep 21 17:26:31 2021 user.warn basicstation[19639]: [GPS:WARN] GPS garbage: $GPGSV,32,11,12,80,016,23,18,12,302,32,20,55,097,34,24,09,342,20*7C
Tue Sep 21 17:26:31 2021 user.err basicstation[19639]: [GPS:ERRO] NMEA checksum error: 46 vs 5F
Tue Sep 21 17:26:31 2021 user.warn basicstation[19639]: [GPS:WARN] GPS garbage: $GPGSV,3,3,11,25,64,235,,29,34,231,2,04,224,27*46
Tue Sep 21 17:26:31 2021 user.err basicstation[19639]: [GPS:ERRO] NMEA checksum error: 79 vs 7A
Tue Sep 21 17:26:31 2021 user.warn basicstation[19639]: [GPS:WARN] GPS garbage: $GPGLL,31.00629,S,15139.08863,E,072608.00,A,A*79
Tue Sep 21 17:26:31 2021 user.err basicstation[19639]: [GPS:ERRO] NMEA checksum error: FFFFFFFF vs 71
Tue Sep 21 17:26:31 2021 user.warn basicstation[19639]: [GPS:WARN] GPS garbage: $GPGSV,3,1,11,02,44,144,34,05,52,035,12,06,07,132,26,11,38,141,21*
Tue Sep 21 17:26:31 2021 user.err basicstation[19639]: [GPS:ERRO] NMEA checksum error: 7F vs 51
Tue Sep 21 17:26:31 2021 user.warn basicstation[19639]: [GPS:WARN] GPS garbage: $GPGSV,3,2,11,12,80,016,23,18,12,302,20,55,097,34,24,09,342,20*7F
Tue Sep 21 17:26:31 2021 user.warn basicstation[19639]: [GPS:WARN] GPS garbage: $GPGSV,3,2,11,12,80,016,22,18,12,302,30,20,55,097,35,24,09,342,1
Tue Sep 21 17:26:34 2021 kern.info ap_client: apcli0 is not associated
Tue Sep 21 17:26:34 2021 kern.info ap_client: Scanning for networks...
Tue Sep 21 17:26:39 2021 kern.info ap_client: Found network - 11 Telstra0D73 44:94:fc:28:9c:9e WPA2PSK
Tue Sep 21 17:26:39 2021 kern.info ap_client: No signal found to connect to
Tue Sep 21 17:26:44 2021 kern.info ap_client: apcli0 is not associated
Tue Sep 21 17:26:44 2021 kern.info ap_client: Scanning for networks...
Tue Sep 21 17:26:46 2021 user.err basicstation[19639]: [GPS:ERRO] NMEA checksum error: 4C vs 68
Tue Sep 21 17:26:46 2021 user.warn basicstation[19639]: [GPS:WARN] GPS garbage: $GPGSV,3,3,11,25,64,235,29,35,231,30,31,04,224,22*4C
Tue Sep 21 17:26:49 2021 kern.info ap_client: Found network - 6 XXXXXXXXX 1c:87:2c:69:4d:c0 WPA2PSK
Tue Sep 21 17:26:49 2021 kern.info ap_client: Found network - 11 Telstra0D73 44:94:fc:28:9c:9e WPA2PSK
Tue Sep 21 17:26:49 2021 kern.info ap_client: Found network, trying to associate (essid: XXXXXXXXX, bssid: 1c:87:2c:69:4d:c0, channel: 6, enc: WPA2PSK, crypto: AES)
Tue Sep 21 17:26:49 2021 kern.info ap_client: Cannot associate XXXXXXXXX, retry 5min later
Tue Sep 21 17:26:51 2021 user.err basicstation[19639]: [GPS:ERRO] NMEA checksum error: 60 vs 58
Tue Sep 21 17:26:51 2021 user.warn basicstation[19639]: [GPS:WARN] GPS garbage: $GPRMC,072649.00,A,3031.00779,S,15139.08687,E,0.04,,210921,,,A*60
Tue Sep 21 17:26:51 2021 user.err basicstation[19639]: [GPS:ERRO] NMEA checksum error: 2E vs 28
Tue Sep 21 17:26:51 2021 user.warn basicstation[19639]: [GPS:WARN] GPS garbage: $GPVT,,T,,M,0.084,N,0.155,K,*2E
Tue Sep 21 17:26:51 2021 user.err basicstation[19639]: [GPS:ERRO] NMEA checksum error: 0A vs 59
Tue Sep 21 17:26:51 2021 user.warn basicstation[19639]: [GPS:WARN] GPS garbage: $GPG,3,12,24,06,18,29,02,20,,,1.54,1.08,1.10*0A
Tue Sep 21 17:26:51 2021 user.err basicstation[19639]: [GPS:ERRO] NMEA checksum error: 72 vs 46
Tue Sep 21 17:26:51 2021 user.warn basicstation[19639]: [GPS:WARN] GPS garbage: $GPGSV,3,1,11,02,43,14,33,05,52,035,12,06,06,132,27,11,38,140,23*72
Tue Sep 21 17:26:51 2021 user.info basicstation[19639]: [any:INFO] /var/etc/station/tc.trust: 
cert. version     : 3
serial number     : 82:10:CF:B0:D2:40:E3:59:44:63:E0:BB:63:82:8B:00
issuer name       : C=US, O=Internet Security Research Group, CN=ISRG Root X1
subject name      : C=US, O=Internet Security Research Group, CN=ISRG Root X1
issued  on        : 2015-06-04 11:04:38
expires on        : 2035-06-04 11:04:38
signed using      : RSA with SHA-256
RSA key size      : 4096 bits
basic constraints : CA=Tue Sep 21 17:26:51 2021 user.info basicstation[19639]: [AIO:INFO] tc has no cert configured - running server auth and client auth with token
Tue Sep 21 17:27:06 2021 user.err basicstation[19639]: [TCE:ERRO] TC connect failed - URI: wss://au1.cloud.thethings.network:8887
Tue Sep 21 17:27:06 2021 user.info basicstation[19639]: [TCE:INFO] INFOS reconnect backoff 30s (retry 3)
Tue Sep 21 17:27:36 2021 user.info basicstation[19639]: [any:INFO] /var/etc/station/tc.trust: 
cert. version     : 3
serial number     : 82:10:CF:B0:D2:40:E3:59:44:63:E0:BB:63:82:8B:00
issuer name       : C=US, O=Internet Security Research Group, CN=ISRG Root X1
subject name      : C=US, O=Internet Security Research Group, CN=ISRG Root X1
issued  on        : 2015-06-04 11:04:38
expires on        : 2035-06-04 11:04:38
signed using      : RSA with SHA-256
RSA key size      : 4096 bits
basic constraints : CA=Tue Sep 21 17:27:36 2021 user.info basicstation[19639]: [AIO:INFO] tc has no cert configured - running server auth and client auth with token
Tue Sep 21 17:27:51 2021 user.err basicstation[19639]: [TCE:ERRO] TC connect failed - URI: wss://au1.cloud.thethings.network:8887
Tue Sep 21 17:27:51 2021 user.info basicstation[19639]: [TCE:INFO] INFOS reconnect backoff 40s (retry 4)
Tue Sep 21 17:27:55 2021 user.info mwan3track: Lost 33 ping(s) on interface wan0 (apcli0)
Tue Sep 21 17:27:59 2021 user.warn basicstation[19639]: [LOG:WARN] LoRa modulation error: 0
Tue Sep 21 17:27:59 2021 user.warn basicstation[19639]: [LOG:WARN] LoRa modulation error: 0
Tue Sep 21 17:27:59 2021 user.warn basicstation[19639]: [LOG:WARN] LoRa modulation error: 0
Tue Sep 21 17:27:59 2021 user.warn basicstation[19639]: [LOG:WARN] LoRa modulation error: 0
Tue Sep 21 17:27:59 2021 user.warn basicstation[19639]: [LOG:WARN] LoRa modulation error: 0
Tue Sep 21 17:27:59 2021 user.warn basicstation[19639]: [LOG:WARN] LoRa modulation error: 0
Tue Sep 21 17:27:59 2021 user.warn basicstation[19639]: [LOG:WARN] LoRa modulation error: 0
Tue Sep 21 17:28:00 2021 user.warn basicstation[19639]: [LOG:WARN] LoRa modulation error: 0
Tue Sep 21 17:28:00 2021 user.warn basicstation[19639]: [LOG:WARN] LoRa modulation error: 0
Tue Sep 21 17:28:00 2021 user.warn basicstation[19639]: [LOG:WARN] LoRa modulation error: 0
Tue Sep 21 17:28:00 2021 user.warn basicstation[19639]: [LOG:WARN] LoRa modulation error: 0
Tue Sep 21 17:28:00 2021 user.warn basicstation[19639]: [LOG:WARN] LoRa modulation error: 0
Tue Sep 21 17:28:00 2021 user.info basicstation[19639]: [LOG:INFO] dutycycle size: 74322

Those lines look like they could possibly be a hardware-ish failure or procedure-for-operating-hardware issue when talking to the LoRa card, but I’m not familiar enough with the basicstation version of the software to say for certain.

Could you maybe try it in a classic packet forwarder mode and see what messages you get?

If you’re already in the habit of opening the box, re-seating the LoRa card could be worthwhile, but if you’re not, then probably best to wait for an official answer.

1 Like

Thanks the for suggestions.
I have switched the RAk7240 we have here to Packet Forwarder mode instead of the basic station system, appears to be running fine (but time will tell)

Hardware failure to me does seem strange as the problem not limited 1x gateway, we have 3x gateways so far around the world that I believe had done the bug.

Regards

Toby

I have had similar issues with our RAK7249 since changing to Basic Station. From what I can see it is due to the lora card not resetting correctly, but so far the only solution I have found is to power cycle the unit.
Looking at the scripts that are supposed to perform the reset (/etc/station/radio_init.sh) they use GPIO 11 which I would assume to be correct give that it is embedded in the firmware but is it possible that this is incorrect for the RAK7249?