Gateway connects/disconnects all the time after update to TTN v3

LPWAN Industrial Gateways / Concentrators RAK7258
1

LoRa® Server: TTN v3 with Basic Station

Details:
Yesterday I migrated my gateway (RAK7258) to V3 (in Basic Station Mode).
Everything worked ok and the gateway was online after some trial and error with settings for authentication mode, trust and token. First new Packets from devices came in shortly afterwards…

…but today it’s another story. After a power cycle of the gateway no more packets are sent and the gateway keeps connecting/disconnecting all the time with the following debug output:

Wed Dec  8 17:54:49 2021 user.info basicstation[19057]: [TCE:INFO] INFOS reconnect backoff 10s (retry 1)
Wed Dec  8 17:54:59 2021 user.info basicstation[19057]: [any:INFO] /var/etc/station/tc.trust: 
cert. version     : 3
serial number     : 82:10:CF:B0:D2:40:E3:59:44:63:E0:BB:63:82:8B:00
issuer name       : C=US, O=Internet Security Research Group, CN=ISRG Root X1
subject name      : C=US, O=Internet Security Research Group, CN=ISRG Root X1
issued  on        : 2015-06-04 11:04:38
expires on        : 2035-06-04 11:04:38
signed using      : RSA with SHA-256
RSA key size      : 4096 bits
basic constraints : CA=Wed Dec  8 17:54:59 2021 user.info basicstation[19057]: [AIO:INFO] tc has no cert configured - running server auth and client auth with token
Wed Dec  8 17:54:59 2021 user.info basicstation[19057]: [TCE:INFO] Connecting to INFOS: wss://eu1.cloud.thethings.network:8887
Wed Dec  8 17:54:59 2021 user.info basicstation[19057]: [TCE:INFO] Infos: 60c5:a8ff:fe76:64aa muxs-::0 wss://eu1.cloud.thethings.network:8887/traffic/eui-60C5A8FFFE7664AA
Wed Dec  8 17:54:59 2021 user.info basicstation[19057]: [any:INFO] /var/etc/station/tc.trust: 
cert. version     : 3
serial number     : 82:10:CF:B0:D2:40:E3:59:44:63:E0:BB:63:82:8B:00
issuer name       : C=US, O=Internet Security Research Group, CN=ISRG Root X1
subject name      : C=US, O=Internet Security Research Group, CN=ISRG Root X1
issued  on        : 2015-06-04 11:04:38
expires on        : 2035-06-04 11:04:38
signed using      : RSA with SHA-256
RSA key size      : 4096 bits
basic constraints : CA=Wed Dec  8 17:54:59 2021 user.info basicstation[19057]: [AIO:INFO] tc has no cert configured - running server auth and client auth with token
Wed Dec  8 17:54:59 2021 user.warn basicstation[19057]: [RAL:WARN] Ignoring unsupported/unknown field: antenna_gain
Wed Dec  8 17:54:59 2021 user.info basicstation[19057]: [SYS:INFO] Process /etc/station/radio_init.sh (pid=20133) completed
Wed Dec  8 17:54:59 2021 user.info basicstation[19057]: [RAL:INFO] Lora gateway library version: Version: 5.0.1;
Wed Dec  8 17:54:59 2021 user.info basicstation[19057]: [RAL:INFO] SX1301 rxrfchain 0: enable=1 freq=867.5MHz rssi_offset=-158.000000 type=2 tx_enable=1 tx_notch_freq=0
Wed Dec  8 17:54:59 2021 user.info basicstation[19057]: [RAL:INFO] SX1301 rxrfchain 1: enable=1 freq=868.5MHz rssi_offset=-158.000000 type=2 tx_enable=0 tx_notch_freq=0
Wed Dec  8 17:54:59 2021 user.info basicstation[19057]: [RAL:INFO] SX1301 ifchain  0: enable=1 rf_chain=1 freq=-400000 bandwidth=0 datarate=0 sync_word=0/0
Wed Dec  8 17:54:59 2021 user.info basicstation[19057]: [RAL:INFO] SX1301 ifchain  1: enable=1 rf_chain=1 freq=-200000 bandwidth=0 datarate=0 sync_word=0/0
Wed Dec  8 17:54:59 2021 user.info basicstation[19057]: [RAL:INFO] SX1301 ifchain  2: enable=1 rf_chain=1 freq=0 bandwidth=0 datarate=0 sync_word=0/0
Wed Dec  8 17:54:59 2021 user.info basicstation[19057]: [RAL:INFO] SX1301 ifchain  3: enable=1 rf_chain=0 freq=-400000 bandwidth=0 datarate=0 sync_word=0/0
Wed Dec  8 17:54:59 2021 user.info basicstation[19057]: [RAL:INFO] SX1301 ifchain  4: enable=1 rf_chain=0 freq=-200000 bandwidth=0 datarate=0 sync_word=0/0
Wed Dec  8 17:54:59 2021 user.info basicstation[19057]: [RAL:INFO] SX1301 ifchain  5: enable=1 rf_chain=0 freq=0 bandwidth=0 datarate=0 sync_word=0/0
Wed Dec  8 17:54:59 2021 user.info basicstation[19057]: [RAL:INFO] SX1301 ifchain  6: enable=1 rf_chain=0 freq=200000 bandwidth=0 datarate=0 sync_word=0/0
Wed Dec  8 17:54:59 2021 user.info basicstation[19057]: [RAL:INFO] SX1301 ifchain  7: enable=1 rf_chain=0 freq=400000 bandwidth=0 datarate=0 sync_word=0/0
Wed Dec  8 17:54:59 2021 user.info basicstation[19057]: [RAL:INFO] SX1301 ifchain  8: enable=1 rf_chain=1 freq=-200000 bandwidth=2 datarate=2 sync_word=0/0
Wed Dec  8 17:54:59 2021 user.info basicstation[19057]: [RAL:INFO] SX1301 ifchain  9: enable=1 rf_chain=1 freq=300000 bandwidth=3 datarate=50000 sync_word=0/0
Wed Dec  8 17:54:59 2021 user.info basicstation[19057]: [RAL:INFO] SX130x LBT not enabled
Wed Dec  8 17:54:59 2021 user.err basicstation[19057]: [RAL:ERRO] Concentrator start failed: lgw_start
Wed Dec  8 17:54:59 2021 user.err basicstation[19057]: [RAL:ERRO] ral_config failed with status 0x08
Wed Dec  8 17:54:59 2021 user.err basicstation[19057]: [any:ERRO] Closing connection to muxs - error in s2e_onMsg
Wed Dec  8 17:54:59 2021 user.info basicstation[19057]: [TCE:INFO] INFOS reconnect backoff 10s (retry 1)

and ttn live data console shows this:

.
.
19:14:34 Connect gateway
19:14:23 Disconnect gateway
19:14:23 Receive gateway status  (Versions firmware""package""platform"linux - Firmware - Protocol 2"station"2.0.4-9-g3d5c686(linux/std)"...
19:14:23 Connect gateway
.
.

any ideas what’s wrong here?

I posted the issue in TTN forum as well:
https://www.thethingsnetwork.org/forum/t/gateway-connects-disconnects-all-the-time-after-update-to-v3/53747

2

nobody with a slution or a hint here?
@Martin do you have an idea where to look?

3

Hello @meberli,

Please check you DM.

4

@Martin Why DM?
We have 4 RAK7249 here. Seeing the same problem with TTN v3. Only solution we found so far is to power cycle the units which is no a viable option at all as those units are deployed at remote location.

5

Hello @loti,

I was requiring some information like gateway EUI to investigate the problem, that is the reason why we switched to DM.
What firmware versions are your gateways using?

6

@Martin Thanks for your reply. I found another thread on the forum that says the firmware release in January patches this very problem, although the link to the firmware is dead. Found the firmware Firmware - downloads.rakwireless.com > LoRa > DIY-Gateway-RAK7249 > Firmware and indeed it fixes the problem.