RAK7240 - Basics Station Disconnect/Connect Bug

LPWAN Industrial Gateways / Concentrators
1

Hi All,

Over last few months I have had 3x Gateways (2x RAK7240 and 1x RAK7258) cease to work/receive payloads unless hard rebooted.

This appears to be a Basics Station connect/disconnect bug.

Below logs are from RAK7240 attached via WiFi, no SIM card installed and LTE disabled.

Another RAK7240 in the field is ONLY using LTE/4G back-haul, WiFi is turned on as a Access Point for administration only.

Another RAK7258 in the field the same - with ONLY using LTE/4G back-haul, WiFi is turned on as a Access Point for administration only

All gateways according my our records running WisGateOS_1.0.2 (RAK7240 and RAK7258) EXCEPT the one i have here, running 1.2.1_RAK rRAK-544bc84 version (latest?)

Little investigation shows disconnect/connect over and over in the TTN console.

TTNv3 Live Data - connect disconnect
TTNv3 Live Data - connect disconnect1294×672 22 KB

I believe this affects both RAK7240 and possibly RAK7258 - uncertain as I haven’t had remote access to view logs etc, however this time our local RAK7240 has locked up, stating a never ending bug of:

Tue Sep 21 17:22:57 2021 user.err basicstation[19639]: [RAL:ERRO] Concentrator start failed: lgw_start
Tue Sep 21 17:22:57 2021 user.err basicstation[19639]: [RAL:ERRO] ral_config failed with status 0x08
Tue Sep 21 17:22:57 2021 user.err basicstation[19639]: [any:ERRO] Closing connection to muxs - error in s2e_onMsg
Tue Sep 21 17:22:57 2021 user.info basicstation[19639]: [TCE:INFO] INFOS reconnect backoff 10s (retry 1)

Attempting to software reboot (from System section) of the gateway here with still results with the gateway not working correctly?

There also seems to be some mention of bogus GPS, note at the moment this RAK7240 is indoors - so getting maybe bad GPS reception.

All other gateways are outdoors (RAK7258 no GPS, RAK7240 good GPS direct view of sky)

Somewhat recent snipped of the log file attached:

Tue Sep 21 17:24:58 2021 user.info basicstation[19639]: [TCE:INFO] INFOS reconnect backoff 10s (retry 1)
Tue Sep 21 17:25:08 2021 user.info basicstation[19639]: [any:INFO] /var/etc/station/tc.trust: 
cert. version     : 3
serial number     : 82:10:CF:B0:D2:40:E3:59:44:63:E0:BB:63:82:8B:00
issuer name       : C=US, O=Internet Security Research Group, CN=ISRG Root X1
subject name      : C=US, O=Internet Security Research Group, CN=ISRG Root X1
issued  on        : 2015-06-04 11:04:38
expires on        : 2035-06-04 11:04:38
signed using      : RSA with SHA-256
RSA key size      : 4096 bits
basic constraints : CA=Tue Sep 21 17:25:08 2021 user.info basicstation[19639]: [AIO:INFO] tc has no cert configured - running server auth and client auth with token
Tue Sep 21 17:25:10 2021 kern.info ap_client: apcli0 is not associated
Tue Sep 21 17:25:10 2021 kern.info ap_client: Scanning for networks...
Tue Sep 21 17:25:15 2021 kern.info ap_client: Found network - 1 Optus_07980F 48:d2:4f:07:98:11 WPA2PSK
Tue Sep 21 17:25:15 2021 kern.info ap_client: Found network - 6 XXXXXXXXX 1c:87:2c:69:4d:c0 WPA2PSK
Tue Sep 21 17:25:15 2021 kern.info ap_client: Found network - 6 Telstra642AEB a4:91:b1:64:2a:eb WPA2PSK
Tue Sep 21 17:25:15 2021 kern.info ap_client: Found network, trying to associate (essid: XXXXXXXXXXX, bssid: 1c:87:2c:69:4d:c0, channel: 6, enc: WPA2PSK, crypto: AES)
Tue Sep 21 17:25:21 2021 kern.info ap_client: apcli0 is not associated
Tue Sep 21 17:25:21 2021 kern.info ap_client: Scanning for networks...
Tue Sep 21 17:25:23 2021 user.err basicstation[19639]: [TCE:ERRO] TC connect failed - URI: wss://au1.cloud.thethings.network:8887
Tue Sep 21 17:25:23 2021 user.info basicstation[19639]: [TCE:INFO] INFOS reconnect backoff 20s (retry 2)
Tue Sep 21 17:25:23 2021 user.err basicstation[19639]: [GPS:ERRO] NMEA checksum error: 79 vs 70
Tue Sep 21 17:25:23 2021 user.warn basicstation[19639]: [GPS:WARN] GPS garbage: $GPGSV,3,2,11,12,80,016,2011,302,29,20,55,096,35,24,10,342,27*79
Tue Sep 21 17:25:23 2021 user.err basicstation[19639]: [GPS:ERRO] NMEA checksum error: 4B vs 10
Tue Sep 21 17:25:23 2021 user.warn basicstation[19639]: [GPS:WARN] GPS garbage: $PGSV,3,3,11,25,63,234,2,29,34,232,09,31,04,22326*4B
Tue Sep 21 17:25:23 2021 user.err basicstation[19639]: [GPS:ERRO] NMEA checksum error: 6B vs 76
Tue Sep 21 17:25:23 2021 user.warn basicstation[19639]: [GPS:WARN] GPS garbage: $GPRMC,072521.00,A,3031.00471,S5139.08843,E,0.117,,210921,,,A*6B
Tue Sep 21 17:25:23 2021 user.err basicstation[19639]: [GPS:ERRO] NMEA checksum error: 7C vs 4C
Tue Sep 21 17:25:23 2021 user.warn basicstation[19639]: [GPS:WARN] GPS garbage: $GPGLL,331.00471,S,15139.08843,E,072521.00,A,A*7C
Tue Sep 21 17:25:26 2021 kern.info ap_client: Found network - 6 XXXXXXXXXX 1c:87:2c:69:4d:c0 WPA2PSK
Tue Sep 21 17:25:26 2021 kern.info ap_client: Found network, trying to associate (essid: XXXXXXXXXX, bssid: 1c:87:2c:69:4d:c0, channel: 6, enc: WPA2PSK, crypto: AES)
Tue Sep 21 17:25:28 2021 user.err basicstation[19639]: [GPS:ERRO] NMEA checksum error: 2F vs 1F
Tue Sep 21 17:25:28 2021 user.warn basicstation[19639]: [GPS:WARN] GPS garbage: $GPVTG,,T,,M,0.048,N,0.88,K,A*2F
Tue Sep 21 17:25:28 2021 user.err basicstation[19639]: [GPS:ERRO] NMEA checksum error: 71 vs 4F
Tue Sep 21 17:25:28 2021 user.warn basicstation[19639]: [GPS:WARN] GPS garbage: $GPGGA,07252.00,3031.00450,S,15139.886,E,1,08,1.05,1025.9,M,30.5,M,,*71
Tue Sep 21 17:25:28 2021 user.err basicstation[19639]: [GPS:ERRO] NMEA checksum error: 08 vs 26
Tue Sep 21 17:25:28 2021 user.warn basicstation[19639]: [GPS:WARN] GPS garbage: $GPGSA,A,3,12,24,25,06,18,29,02,,,1.49,1.05,1.05*08
Tue Sep 21 17:25:28 2021 user.err basicstation[19639]: [GPS:ERRO] NMEA checksum error: 72 vs 75
Tue Sep 21 17:25:28 2021 user.warn basicstation[19639]: [GPS:WARN] GPS garbage: $V,3,1,11,02,44,144,33,051,034,11,06,07,132,26,11,39,1425*72
Tue Sep 21 17:25:31 2021 kern.info ap_client: apcli0 is not associated
Tue Sep 21 17:25:31 2021 kern.info ap_client: Scanning for networks...
Tue Sep 21 17:25:34 2021 user.err basicstation[19639]: [GPS:ERRO] NMEA checksum error: 72 vs 76
Tue Sep 21 17:25:34 2021 user.warn basicstation[19639]: [GPS:WARN] GPS garbage: $GPGGA,072532.00,3031.00467,S,15139.08877,E,1,08,1.05,10.6,M,30.5,M,,*72
Tue Sep 21 17:25:36 2021 kern.info ap_client: Found network - 6 XXXXXXXXXX1c:87:2c:69:4d:c0 WPA2PSK
Tue Sep 21 17:25:36 2021 kern.info ap_client: Found network, trying to associate (essid: XXXXXXXXXX, bssid: 1c:87:2c:69:4d:c0, channel: 6, enc: WPA2PSK, crypto: AES)
Tue Sep 21 17:25:40 2021 user.notice mwan3track: Interface wan0 (apcli0) is offline
Tue Sep 21 17:25:40 2021 user.notice mwan3: ifdown interface wan0 (apcli0)
Tue Sep 21 17:25:41 2021 user.notice ping-watchdog: wan0 apcli0 ifdown
Tue Sep 21 17:25:42 2021 kern.info ap_client: apcli0 is not associated
Tue Sep 21 17:25:42 2021 kern.info ap_client: Scanning for networks...
Tue Sep 21 17:25:43 2021 user.info basicstation[19639]: [any:INFO] /var/etc/station/tc.trust: 
cert. version     : 3
serial number     : 82:10:CF:B0:D2:40:E3:59:44:63:E0:BB:63:82:8B:00
issuer name       : C=US, O=Internet Security Research Group, CN=ISRG Root X1
subject name      : C=US, O=Internet Security Research Group, CN=ISRG Root X1
issued  on        : 2015-06-04 11:04:38
expires on        : 2035-06-04 11:04:38
signed using      : RSA with SHA-256
RSA key size      : 4096 bits
basic constraints : CA=Tue Sep 21 17:25:43 2021 user.info basicstation[19639]: [AIO:INFO] tc has no cert configured - running server auth and client auth with token
Tue Sep 21 17:25:44 2021 user.info basicstation[19639]: [TCE:INFO] Connecting to INFOS: wss://au1.cloud.thethings.network:8887
Tue Sep 21 17:25:44 2021 user.err basicstation[19639]: [GPS:ERRO] NMEA checksum error: 78 vs 7C
Tue Sep 21 17:25:44 2021 user.warn basicstation[19639]: [GPS:WARN] GPS garbage: $GPGLL,3031.000,S,15139.08877,E,072542.00,A,A*78
Tue Sep 21 17:25:45 2021 user.info basicstation[19639]: [TCE:INFO] Infos: ac1f:9ff:fe04:64e2 muxs-::0 wss://au1.cloud.thethings.network:8887/traffic/eui-AC1F09FFFE0464E2
Tue Sep 21 17:25:45 2021 user.info basicstation[19639]: [any:INFO] /var/etc/station/tc.trust: 
cert. version     : 3
serial number     : 82:10:CF:B0:D2:40:E3:59:44:63:E0:BB:63:82:8B:00
issuer name       : C=US, O=Internet Security Research Group, CN=ISRG Root X1
subject name      : C=US, O=Internet Security Research Group, CN=ISRG Root X1
issued  on        : 2015-06-04 11:04:38
expires on        : 2035-06-04 11:04:38
signed using      : RSA with SHA-256
RSA key size      : 4096 bits
basic constraints : CA=Tue Sep 21 17:25:45 2021 user.info basicstation[19639]: [AIO:INFO] tc has no cert configured - running server auth and client auth with token
Tue Sep 21 17:25:46 2021 user.warn basicstation[19639]: [RAL:WARN] Ignoring unsupported/unknown field: antenna_gain
Tue Sep 21 17:25:46 2021 user.info basicstation[19639]: [SYS:INFO] Process /etc/station/radio_init.sh (pid=30992) completed
Tue Sep 21 17:25:46 2021 user.info basicstation[19639]: [RAL:INFO] Lora gateway library version: Version: 5.0.1;
Tue Sep 21 17:25:46 2021 user.info basicstation[19639]: [RAL:INFO] SX1301 rxrfchain 0: enable=1 freq=917.2MHz rssi_offset=-159.000000 type=2 tx_enable=1 tx_notch_freq=0
Tue Sep 21 17:25:46 2021 user.info basicstation[19639]: [RAL:INFO] SX1301 rxrfchain 1: enable=1 freq=917.9MHz rssi_offset=-159.000000 type=2 tx_enable=0 tx_notch_freq=0
Tue Sep 21 17:25:46 2021 user.info basicstation[19639]: [RAL:INFO] SX1301 ifchain  0: enable=1 rf_chain=0 freq=-400000 bandwidth=0 datarate=0 sync_word=0/0
Tue Sep 21 17:25:46 2021 user.info basicstation[19639]: [RAL:INFO] SX1301 ifchain  1: enable=1 rf_chain=0 freq=-200000 bandwidth=0 datarate=0 sync_word=0/0
Tue Sep 21 17:25:46 2021 user.info basicstation[19639]: [RAL:INFO] SX1301 ifchain  2: enable=1 rf_chain=0 freq=0 bandwidth=0 datarate=0 sync_word=0/0
Tue Sep 21 17:25:46 2021 user.info basicstation[19639]: [RAL:INFO] SX1301 ifchain  3: enable=1 rf_chain=0 freq=200000 bandwidth=0 datarate=0 sync_word=0/0
Tue Sep 21 17:25:46 2021 user.info basicstation[19639]: [RAL:INFO] SX1301 ifchain  4: enable=1 rf_chain=1 freq=-300000 bandwidth=0 datarate=0 sync_word=0/0
Tue Sep 21 17:25:46 2021 user.info basicstation[19639]: [RAL:INFO] SX1301 ifchain  5: enable=1 rf_chain=1 freq=-100000 bandwidth=0 datarate=0 sync_word=0/0
Tue Sep 21 17:25:46 2021 user.info basicstation[19639]: [RAL:INFO] SX1301 ifchain  6: enable=1 rf_chain=1 freq=100000 bandwidth=0 datarate=0 sync_word=0/0
Tue Sep 21 17:25:46 2021 user.info basicstation[19639]: [RAL:INFO] SX1301 ifchain  7: enable=1 rf_chain=1 freq=300000 bandwidth=0 datarate=0 sync_word=0/0
Tue Sep 21 17:25:46 2021 user.info basicstation[19639]: [RAL:INFO] SX1301 ifchain  8: enable=1 rf_chain=0 freq=300000 bandwidth=1 datarate=4 sync_word=0/0
Tue Sep 21 17:25:46 2021 user.info basicstation[19639]: [RAL:INFO] SX1301 ifchain  9: enable=0 rf_chain=0 freq=0 bandwidth=0 datarate=0 sync_word=0/0
Tue Sep 21 17:25:46 2021 user.info basicstation[19639]: [RAL:INFO] SX130x LBT not enabled
Tue Sep 21 17:25:46 2021 user.err basicstation[19639]: [RAL:ERRO] Concentrator start failed: lgw_start
Tue Sep 21 17:25:46 2021 user.err basicstation[19639]: [RAL:ERRO] ral_config failed with status 0x08
Tue Sep 21 17:25:46 2021 user.err basicstation[19639]: [any:ERRO] Closing connection to muxs - error in s2e_onMsg
Tue Sep 21 17:25:46 2021 user.info basicstation[19639]: [TCE:INFO] INFOS reconnect backoff 10s (retry 1)
Tue Sep 21 17:25:47 2021 user.info mwan3track: Lost 9 ping(s) on interface wan0 (apcli0)
Tue Sep 21 17:25:47 2021 kern.info ap_client: Found network - 6 XXXXXXXXX1c:87:2c:69:4d:c0 WPA2PSK
Tue Sep 21 17:25:47 2021 kern.info ap_client: Found network - 6 XXXXXXXXX 1c:87:2c:69:49:28 WPA2PSK
Tue Sep 21 17:25:47 2021 kern.info ap_client: Found network - 11 DCA 00:1f:33:83:c7:40 WPA2PSK
Tue Sep 21 17:25:47 2021 kern.info ap_client: Found network, trying to associate (essid: XXXXXXXXX, bssid: 1c:87:2c:69:4d:c0, channel: 6, enc: WPA2PSK, crypto: AES)
Tue Sep 21 17:25:53 2021 kern.info ap_client: apcli0 is not associated
Tue Sep 21 17:25:53 2021 kern.info ap_client: Scanning for networks...
Tue Sep 21 17:25:55 2021 user.err basicstation[19639]: [GPS:ERRO] NMEA checksum error: 7E vs 07
Tue Sep 21 17:25:55 2021 user.warn basicstation[19639]: [GPS:WARN] GPS garbage: $GPGGA,072553.00,3031.00546,S,15139.08887,E,1,07,1.08,10,30.5,M,,*7E
Tue Sep 21 17:25:56 2021 user.info basicstation[19639]: [any:INFO] /var/etc/station/tc.trust: 
cert. version     : 3
serial number     : 82:10:CF:B0:D2:40:E3:59:44:63:E0:BB:63:82:8B:00
issuer name       : C=US, O=Internet Security Research Group, CN=ISRG Root X1
subject name      : C=US, O=Internet Security Research Group, CN=ISRG Root X1
issued  on        : 2015-06-04 11:04:38
expires on        : 2035-06-04 11:04:38
signed using      : RSA with SHA-256
RSA key size      : 4096 bits
basic constraints : CA=Tue Sep 21 17:25:56 2021 user.info basicstation[19639]: [AIO:INFO] tc has no cert configured - running server auth and client auth with token
Tue Sep 21 17:25:58 2021 kern.info ap_client: No results
Tue Sep 21 17:25:58 2021 kern.info ap_client: No signal found to connect to
Tue Sep 21 17:26:03 2021 kern.info ap_client: apcli0 is not associated
Tue Sep 21 17:26:03 2021 kern.info ap_client: Scanning for networks...
Tue Sep 21 17:26:08 2021 kern.info ap_client: Found network - 6 XXXXXXXXX 1c:87:2c:69:4d:c0 WPA2PSK
Tue Sep 21 17:26:08 2021 kern.info ap_client: Found network, trying to associate (essid: XXXXXXXXX, bssid: 1c:87:2c:69:4d:c0, channel: 6, enc: WPA2PSK, crypto: AES)
Tue Sep 21 17:26:13 2021 kern.info ap_client: apcli0 is not associated
Tue Sep 21 17:26:13 2021 kern.info ap_client: Scanning for networks...
Tue Sep 21 17:26:18 2021 kern.info ap_client: Found network - 6 XXXXXXXXX 1c:87:2c:69:49:28 WPA2PSK
Tue Sep 21 17:26:19 2021 kern.info ap_client: No signal found to connect to
Tue Sep 21 17:26:24 2021 kern.info ap_client: apcli0 is not associated
Tue Sep 21 17:26:24 2021 kern.info ap_client: Scanning for networks...
Tue Sep 21 17:26:29 2021 kern.info ap_client: Found network - 6 XXXXXXXXX 1c:87:2c:69:49:28 WPA2PSK
Tue Sep 21 17:26:29 2021 kern.info ap_client: Found network - 11 Optus_573AB7 48:d2:4f:57:3a:b9 WPA2PSK
Tue Sep 21 17:26:29 2021 kern.info ap_client: No signal found to connect to
Tue Sep 21 17:26:31 2021 user.err basicstation[19639]: [TCE:ERRO] TC connect failed - URI: wss://au1.cloud.thethings.network:8887
Tue Sep 21 17:26:31 2021 user.info basicstation[19639]: [TCE:INFO] INFOS reconnect backoff 20s (retry 2)
Tue Sep 21 17:26:31 2021 user.err basicstation[19639]: [GPS:ERRO] NMEA checksum error: 7F vs 52
Tue Sep 21 17:26:31 2021 user.warn basicstation[19639]: [GPS:WARN] GPS garbage: $GPG3,1,11,02,44,144,34,05,2,035,09,06,07,132,27,1,38,141,24*7F
Tue Sep 21 17:26:31 2021 user.err basicstation[19639]: [GPS:ERRO] NMEA checksum error: 7C vs 50
Tue Sep 21 17:26:31 2021 user.warn basicstation[19639]: [GPS:WARN] GPS garbage: $GPGSV,32,11,12,80,016,23,18,12,302,32,20,55,097,34,24,09,342,20*7C
Tue Sep 21 17:26:31 2021 user.err basicstation[19639]: [GPS:ERRO] NMEA checksum error: 46 vs 5F
Tue Sep 21 17:26:31 2021 user.warn basicstation[19639]: [GPS:WARN] GPS garbage: $GPGSV,3,3,11,25,64,235,,29,34,231,2,04,224,27*46
Tue Sep 21 17:26:31 2021 user.err basicstation[19639]: [GPS:ERRO] NMEA checksum error: 79 vs 7A
Tue Sep 21 17:26:31 2021 user.warn basicstation[19639]: [GPS:WARN] GPS garbage: $GPGLL,31.00629,S,15139.08863,E,072608.00,A,A*79
Tue Sep 21 17:26:31 2021 user.err basicstation[19639]: [GPS:ERRO] NMEA checksum error: FFFFFFFF vs 71
Tue Sep 21 17:26:31 2021 user.warn basicstation[19639]: [GPS:WARN] GPS garbage: $GPGSV,3,1,11,02,44,144,34,05,52,035,12,06,07,132,26,11,38,141,21*
Tue Sep 21 17:26:31 2021 user.err basicstation[19639]: [GPS:ERRO] NMEA checksum error: 7F vs 51
Tue Sep 21 17:26:31 2021 user.warn basicstation[19639]: [GPS:WARN] GPS garbage: $GPGSV,3,2,11,12,80,016,23,18,12,302,20,55,097,34,24,09,342,20*7F
Tue Sep 21 17:26:31 2021 user.warn basicstation[19639]: [GPS:WARN] GPS garbage: $GPGSV,3,2,11,12,80,016,22,18,12,302,30,20,55,097,35,24,09,342,1
Tue Sep 21 17:26:34 2021 kern.info ap_client: apcli0 is not associated
Tue Sep 21 17:26:34 2021 kern.info ap_client: Scanning for networks...
Tue Sep 21 17:26:39 2021 kern.info ap_client: Found network - 11 Telstra0D73 44:94:fc:28:9c:9e WPA2PSK
Tue Sep 21 17:26:39 2021 kern.info ap_client: No signal found to connect to
Tue Sep 21 17:26:44 2021 kern.info ap_client: apcli0 is not associated
Tue Sep 21 17:26:44 2021 kern.info ap_client: Scanning for networks...
Tue Sep 21 17:26:46 2021 user.err basicstation[19639]: [GPS:ERRO] NMEA checksum error: 4C vs 68
Tue Sep 21 17:26:46 2021 user.warn basicstation[19639]: [GPS:WARN] GPS garbage: $GPGSV,3,3,11,25,64,235,29,35,231,30,31,04,224,22*4C
Tue Sep 21 17:26:49 2021 kern.info ap_client: Found network - 6 XXXXXXXXX 1c:87:2c:69:4d:c0 WPA2PSK
Tue Sep 21 17:26:49 2021 kern.info ap_client: Found network - 11 Telstra0D73 44:94:fc:28:9c:9e WPA2PSK
Tue Sep 21 17:26:49 2021 kern.info ap_client: Found network, trying to associate (essid: XXXXXXXXX, bssid: 1c:87:2c:69:4d:c0, channel: 6, enc: WPA2PSK, crypto: AES)
Tue Sep 21 17:26:49 2021 kern.info ap_client: Cannot associate XXXXXXXXX, retry 5min later
Tue Sep 21 17:26:51 2021 user.err basicstation[19639]: [GPS:ERRO] NMEA checksum error: 60 vs 58
Tue Sep 21 17:26:51 2021 user.warn basicstation[19639]: [GPS:WARN] GPS garbage: $GPRMC,072649.00,A,3031.00779,S,15139.08687,E,0.04,,210921,,,A*60
Tue Sep 21 17:26:51 2021 user.err basicstation[19639]: [GPS:ERRO] NMEA checksum error: 2E vs 28
Tue Sep 21 17:26:51 2021 user.warn basicstation[19639]: [GPS:WARN] GPS garbage: $GPVT,,T,,M,0.084,N,0.155,K,*2E
Tue Sep 21 17:26:51 2021 user.err basicstation[19639]: [GPS:ERRO] NMEA checksum error: 0A vs 59
Tue Sep 21 17:26:51 2021 user.warn basicstation[19639]: [GPS:WARN] GPS garbage: $GPG,3,12,24,06,18,29,02,20,,,1.54,1.08,1.10*0A
Tue Sep 21 17:26:51 2021 user.err basicstation[19639]: [GPS:ERRO] NMEA checksum error: 72 vs 46
Tue Sep 21 17:26:51 2021 user.warn basicstation[19639]: [GPS:WARN] GPS garbage: $GPGSV,3,1,11,02,43,14,33,05,52,035,12,06,06,132,27,11,38,140,23*72
Tue Sep 21 17:26:51 2021 user.info basicstation[19639]: [any:INFO] /var/etc/station/tc.trust: 
cert. version     : 3
serial number     : 82:10:CF:B0:D2:40:E3:59:44:63:E0:BB:63:82:8B:00
issuer name       : C=US, O=Internet Security Research Group, CN=ISRG Root X1
subject name      : C=US, O=Internet Security Research Group, CN=ISRG Root X1
issued  on        : 2015-06-04 11:04:38
expires on        : 2035-06-04 11:04:38
signed using      : RSA with SHA-256
RSA key size      : 4096 bits
basic constraints : CA=Tue Sep 21 17:26:51 2021 user.info basicstation[19639]: [AIO:INFO] tc has no cert configured - running server auth and client auth with token
Tue Sep 21 17:27:06 2021 user.err basicstation[19639]: [TCE:ERRO] TC connect failed - URI: wss://au1.cloud.thethings.network:8887
Tue Sep 21 17:27:06 2021 user.info basicstation[19639]: [TCE:INFO] INFOS reconnect backoff 30s (retry 3)
Tue Sep 21 17:27:36 2021 user.info basicstation[19639]: [any:INFO] /var/etc/station/tc.trust: 
cert. version     : 3
serial number     : 82:10:CF:B0:D2:40:E3:59:44:63:E0:BB:63:82:8B:00
issuer name       : C=US, O=Internet Security Research Group, CN=ISRG Root X1
subject name      : C=US, O=Internet Security Research Group, CN=ISRG Root X1
issued  on        : 2015-06-04 11:04:38
expires on        : 2035-06-04 11:04:38
signed using      : RSA with SHA-256
RSA key size      : 4096 bits
basic constraints : CA=Tue Sep 21 17:27:36 2021 user.info basicstation[19639]: [AIO:INFO] tc has no cert configured - running server auth and client auth with token
Tue Sep 21 17:27:51 2021 user.err basicstation[19639]: [TCE:ERRO] TC connect failed - URI: wss://au1.cloud.thethings.network:8887
Tue Sep 21 17:27:51 2021 user.info basicstation[19639]: [TCE:INFO] INFOS reconnect backoff 40s (retry 4)
Tue Sep 21 17:27:55 2021 user.info mwan3track: Lost 33 ping(s) on interface wan0 (apcli0)
Tue Sep 21 17:27:59 2021 user.warn basicstation[19639]: [LOG:WARN] LoRa modulation error: 0
Tue Sep 21 17:27:59 2021 user.warn basicstation[19639]: [LOG:WARN] LoRa modulation error: 0
Tue Sep 21 17:27:59 2021 user.warn basicstation[19639]: [LOG:WARN] LoRa modulation error: 0
Tue Sep 21 17:27:59 2021 user.warn basicstation[19639]: [LOG:WARN] LoRa modulation error: 0
Tue Sep 21 17:27:59 2021 user.warn basicstation[19639]: [LOG:WARN] LoRa modulation error: 0
Tue Sep 21 17:27:59 2021 user.warn basicstation[19639]: [LOG:WARN] LoRa modulation error: 0
Tue Sep 21 17:27:59 2021 user.warn basicstation[19639]: [LOG:WARN] LoRa modulation error: 0
Tue Sep 21 17:28:00 2021 user.warn basicstation[19639]: [LOG:WARN] LoRa modulation error: 0
Tue Sep 21 17:28:00 2021 user.warn basicstation[19639]: [LOG:WARN] LoRa modulation error: 0
Tue Sep 21 17:28:00 2021 user.warn basicstation[19639]: [LOG:WARN] LoRa modulation error: 0
Tue Sep 21 17:28:00 2021 user.warn basicstation[19639]: [LOG:WARN] LoRa modulation error: 0
Tue Sep 21 17:28:00 2021 user.warn basicstation[19639]: [LOG:WARN] LoRa modulation error: 0
Tue Sep 21 17:28:00 2021 user.info basicstation[19639]: [LOG:INFO] dutycycle size: 74322
2

Those lines look like they could possibly be a hardware-ish failure or procedure-for-operating-hardware issue when talking to the LoRa card, but I’m not familiar enough with the basicstation version of the software to say for certain.

Could you maybe try it in a classic packet forwarder mode and see what messages you get?

If you’re already in the habit of opening the box, re-seating the LoRa card could be worthwhile, but if you’re not, then probably best to wait for an official answer.

1 Like
3

Thanks the for suggestions.
I have switched the RAk7240 we have here to Packet Forwarder mode instead of the basic station system, appears to be running fine (but time will tell)

Hardware failure to me does seem strange as the problem not limited 1x gateway, we have 3x gateways so far around the world that I believe had done the bug.

Regards

Toby

4

I have had similar issues with our RAK7249 since changing to Basic Station. From what I can see it is due to the lora card not resetting correctly, but so far the only solution I have found is to power cycle the unit.
Looking at the scripts that are supposed to perform the reset (/etc/station/radio_init.sh) they use GPIO 11 which I would assume to be correct give that it is embedded in the firmware but is it possible that this is incorrect for the RAK7249?

1 Like
5

I have many more gateways with the issues, my action as part of assembly/integration is now just to do Semtech Legacy Packet Forwarder - this at least works so far with TTNv3 / TTS CE

Regards

Toby

6

I’m flagging that I am having the same issue, a reboot does not work, a power cycle is necessary to resolve. I am receiving the same TTNv3 disconnected messages, using Basics Station Mode. This station is also sitting indoors during its trial which could also prove relevant. I have another device the same which is in the field outdoors and is not having the same problem.

I’m a bit concerned since this unit is due to be installed in a remote and inaccessible location soon, so it would be good to have the query about the radio_init.sh script addressed as a temporary workaround.

Thanks

7

Hello,
We actually released a fixed firmware today.
You can download it from here.

Best Regards

1 Like
8

Thanks Nikola,

I will try it out on a problem unit and see if the issue happens again.
Is this firmware for both RAK7240 and RAK7258?

Regards

Toby

9

Hello @tobyICT,

Yes, the firmware is universal for all WisGate Edge series.

1 Like
10

Thanks for confirming, I have loaded it on our RAk7240 first up, will see how it goes

Cheers

Toby