Wwan0 disconnected and unable to reconnect

[trisapeace (Theresa D)]

Hello,

We have a number of RAK7268C with LTE out in the field. We notice that they sometimes fail to reconnect to cellular. We notice this often after a restart and most often when the Gateway has been powered down for a long (>1 day) period of time.

Here are some logs from one of the gateways at the point where the connection failed:

Sat Nov 19 23:37:47 2022 user.notice data-broker: [16] Client mosq-peUlc7j0CmUDDNDsFN sending CONNECT
Sat Nov 19 23:37:47 2022 user.notice data-broker: [16] Client mosq-peUlc7j0CmUDDNDsFN received CONNACK (0)
Sat Nov 19 23:37:47 2022 user.notice data-broker: subscribe: loranet/application/60000/device/#
Sat Nov 19 23:37:47 2022 user.notice data-broker: [16] Client mosq-peUlc7j0CmUDDNDsFN sending SUBSCRIBE (Mid: 1, Topic: loranet/application/60000/device/#, QoS: 2, Options: 0x00)
Sat Nov 19 23:37:47 2022 user.notice data-broker: [16] Client mosq-peUlc7j0CmUDDNDsFN received SUBACK
Sat Nov 19 23:38:07 2022 user.notice mwan3track: Interface wwan (wwan0) is offline
Sat Nov 19 23:38:07 2022 user.notice mwan3: ifdown interface wwan (wwan0)
Sat Nov 19 23:38:08 2022 user.notice ping-watchdog: wwan wwan0 ifdown
Sat Nov 19 23:38:09 2022 user.notice breathing_light: set breathing light to ABNORMAL
Sat Nov 19 23:38:47 2022 user.notice data-broker: [16] Client mosq-peUlc7j0CmUDDNDsFN sending PINGREQ
Sat Nov 19 23:38:47 2022 user.notice data-broker: [16] Client mosq-peUlc7j0CmUDDNDsFN received PINGRESP
Sat Nov 19 23:39:15 2022 user.err basicstation[2101]: [TCE:ERRO] Muxs connect failed - URI: wss://<redacted>.lns.lorawan.us-east-1.amazonaws.com:443/gateway/<redacted>
Sat Nov 19 23:39:39 2022 kern.info quectel-CM[1449]: requestQueryDataCall IPv4ConnectionStatus: DISCONNECTED
Sat Nov 19 23:39:39 2022 kern.info quectel-CM[1449]: ifconfig wwan0 down
Sat Nov 19 23:39:39 2022 daemon.notice netifd: Network device 'wwan0' link is down
Sat Nov 19 23:39:39 2022 daemon.notice netifd: Interface 'wwan' has link connectivity loss
Sat Nov 19 23:39:39 2022 daemon.notice netifd: Interface 'wwan6' has link connectivity loss
Sat Nov 19 23:39:39 2022 kern.info quectel-CM[1449]: ifconfig wwan0 0.0.0.0
Sat Nov 19 23:39:39 2022 daemon.notice netifd: Network device 'wwan0' link is up
Sat Nov 19 23:39:39 2022 daemon.notice netifd: Interface 'wwan' has link connectivity
Sat Nov 19 23:39:39 2022 daemon.notice netifd: Interface 'wwan' is setting up now
Sat Nov 19 23:39:39 2022 daemon.notice netifd: Interface 'wwan6' has link connectivity
Sat Nov 19 23:39:39 2022 daemon.notice netifd: Interface 'wwan6' is setting up now
Sat Nov 19 23:39:39 2022 kern.info quectel-CM[1449]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Attached, DataCap: LTE
Sat Nov 19 23:39:39 2022 daemon.notice netifd: wwan (11405): Received SIGTERM
Sat Nov 19 23:39:39 2022 daemon.notice netifd: Interface 'wwan' is now down
Sat Nov 19 23:39:39 2022 daemon.notice netifd: Interface 'wwan' is setting up now
Sat Nov 19 23:39:39 2022 daemon.warn dnsmasq[2588]: no servers found in /tmp/resolv.conf.auto, will retry
Sat Nov 19 23:39:39 2022 user.notice mwan3: ifdown interface wwan (unknown)
Sat Nov 19 23:39:39 2022 daemon.notice netifd: wwan (20903): udhcpc: option -h NAME is deprecated, use -x hostname:NAME
Sat Nov 19 23:39:39 2022 daemon.notice netifd: wwan (20903): udhcpc (v1.23.2) started
Sat Nov 19 23:39:39 2022 kern.info quectel-CM[1449]: requestSetupDataCall QMUXResult = 0x1, QMUXError = 0xe
Sat Nov 19 23:39:39 2022 kern.info quectel-CM[1449]: Dail Failed 1
Sat Nov 19 23:39:39 2022 daemon.notice netifd: wwan (20903): Sending discover...
Sat Nov 19 23:39:39 2022 kern.info quectel-CM[1449]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Attached, DataCap: LTE
Sat Nov 19 23:39:39 2022 kern.info quectel-CM[1449]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Attached, DataCap: LTE
Sat Nov 19 23:39:39 2022 daemon.notice netifd: Interface 'wwan6' is now down
Sat Nov 19 23:39:39 2022 daemon.notice netifd: Interface 'wwan6' is setting up now
Sat Nov 19 23:39:39 2022 kern.info quectel-CM[1449]: requestSetupDataCall QMUXResult = 0x1, QMUXError = 0xe
Sat Nov 19 23:39:39 2022 kern.info quectel-CM[1449]: Dail Failed 2
Sat Nov 19 23:39:40 2022 user.err basicstation[2101]: [TCE:ERRO] TC connect failed - URI: wss://<redacted>.lns.lorawan.us-east-1.amazonaws.com:443
Sat Nov 19 23:39:40 2022 user.notice ping-watchdog: wwan  ifdown
Sat Nov 19 23:39:42 2022 user.err wisdm[5563]:  failed   ! mbedtls_net_connect returned -0x52
Sat Nov 19 23:39:42 2022 daemon.notice netifd: wwan (20903): Sending discover...
Sat Nov 19 23:39:44 2022 kern.info quectel-CM[1449]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UNKNOW
Sat Nov 19 23:39:44 2022 user.err wisdm[5563]:  failed   ! mbedtls_net_connect returned -0x52
Sat Nov 19 23:39:44 2022 kern.info quectel-CM[1449]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UNKNOW
Sat Nov 19 23:39:44 2022 kern.info quectel-CM[1449]: Dail Failed 3
Sat Nov 19 23:39:45 2022 daemon.notice netifd: wwan (20903): Sending discover...
Sat Nov 19 23:39:47 2022 user.notice data-broker: [16] Client mosq-peUlc7j0CmUDDNDsFN sending PINGREQ
Sat Nov 19 23:39:47 2022 user.notice data-broker: [16] Client mosq-peUlc7j0CmUDDNDsFN received PINGRESP
Sat Nov 19 23:39:48 2022 user.err wisdm[5563]:  failed   ! mbedtls_net_connect returned -0x52
Sat Nov 19 23:39:50 2022 kern.info quectel-CM[1449]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UNKNOW
Sat Nov 19 23:39:50 2022 kern.info quectel-CM[1449]: Dail Failed 4
Sat Nov 19 23:39:53 2022 kern.info quectel-CM[1449]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:39:53 2022 kern.info quectel-CM[1449]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:39:53 2022 kern.info quectel-CM[1449]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:39:53 2022 kern.info quectel-CM[1449]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:39:53 2022 kern.info quectel-CM[1449]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:39:53 2022 kern.info quectel-CM[1449]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:39:54 2022 kern.info quectel-CM[1449]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:39:54 2022 kern.info quectel-CM[1449]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:39:55 2022 kern.info quectel-CM[1449]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:39:55 2022 kern.info quectel-CM[1449]: Dail Failed 5
Sat Nov 19 23:39:56 2022 user.err wisdm[5563]:  failed   ! mbedtls_net_connect returned -0x52
Sat Nov 19 23:40:00 2022 kern.info quectel-CM[1449]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:40:00 2022 kern.info quectel-CM[1449]: Dail Failed 6
Sat Nov 19 23:40:03 2022 kern.info kernel: [178399.000000] syslog.sh (1376): drop_caches: 1
Sat Nov 19 23:40:05 2022 kern.info quectel-CM[1449]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:40:05 2022 kern.info quectel-CM[1449]: Dail Failed 7
Sat Nov 19 23:40:09 2022 kern.info quectel-CM[1449]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:40:10 2022 kern.info quectel-CM[1449]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:40:10 2022 kern.info quectel-CM[1449]: Dail Failed 8
Sat Nov 19 23:40:13 2022 user.err wisdm[5563]:  failed   ! mbedtls_net_connect returned -0x52
Sat Nov 19 23:40:15 2022 kern.info quectel-CM[1449]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:40:15 2022 kern.info quectel-CM[1449]: Dail Failed 9
Sat Nov 19 23:40:20 2022 kern.info quectel-CM[1449]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:40:20 2022 kern.info quectel-CM[1449]: Dail Failed 10
Sat Nov 19 23:40:25 2022 kern.info quectel-CM[1449]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:40:25 2022 kern.info quectel-CM[1449]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:40:25 2022 kern.info quectel-CM[1449]: Dail Failed 11
Sat Nov 19 23:40:30 2022 kern.info quectel-CM[1449]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:40:30 2022 kern.info quectel-CM[1449]: Dail Failed 12
Sat Nov 19 23:40:30 2022 user.err basicstation[2101]: [TCE:ERRO] TC connect failed - URI: wss://<redacted>.lns.lorawan.us-east-1.amazonaws.com:443
Sat Nov 19 23:40:35 2022 kern.info quectel-CM[1449]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:40:35 2022 kern.info quectel-CM[1449]: Dail Failed 13
Sat Nov 19 23:40:40 2022 kern.info quectel-CM[1449]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:40:40 2022 kern.info quectel-CM[1449]: Dail Failed 14
Sat Nov 19 23:40:40 2022 kern.info quectel-CM[1449]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:40:45 2022 user.err wisdm[5563]:  failed   ! mbedtls_net_connect returned -0x52
Sat Nov 19 23:40:45 2022 kern.info quectel-CM[1449]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:40:45 2022 kern.info quectel-CM[1449]: Dail Failed 15
Sat Nov 19 23:40:46 2022 user.notice data-broker: [16] Client mosq-peUlc7j0CmUDDNDsFN sending PINGREQ
Sat Nov 19 23:40:46 2022 user.notice data-broker: [16] Client mosq-peUlc7j0CmUDDNDsFN received PINGRESP
Sat Nov 19 23:40:48 2022 user.notice data-broker: data-broker timeout, restart it
Sat Nov 19 23:40:50 2022 kern.info quectel-CM[1449]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:40:50 2022 kern.info quectel-CM[1449]: Dail Failed 16
Sat Nov 19 23:40:55 2022 kern.info quectel-CM[1449]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:40:55 2022 kern.info quectel-CM[1449]: Dail Failed 17
Sat Nov 19 23:40:55 2022 kern.info quectel-CM[1449]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:40:56 2022 user.notice data-broker: {"60000":{"mqtt":{"keepalive":"10","clean_session":"1","broker_port":"8883","broker_ip":"mq.kritto.net","username":"gateway-pub","tls_version":"tlsv1.2","version":"3.1.1","tls_mode":"ca_signed","auth_enable":"1","password":"<redacted>","qos":"1","retain":"0"}}}
Sat Nov 19 23:40:56 2022 user.notice data-broker: [16] Client mosq-7k231Tz1bzwWLe2ANe sending CONNECT
Sat Nov 19 23:40:56 2022 user.notice data-broker: [16] Client mosq-7k231Tz1bzwWLe2ANe received CONNACK (0)
Sat Nov 19 23:40:56 2022 user.notice data-broker: subscribe: loranet/application/60000/device/#
Sat Nov 19 23:40:56 2022 user.notice data-broker: [16] Client mosq-7k231Tz1bzwWLe2ANe sending SUBSCRIBE (Mid: 1, Topic: loranet/application/60000/device/#, QoS: 2, Options: 0x00)
Sat Nov 19 23:40:56 2022 user.notice data-broker: [16] Client mosq-7k231Tz1bzwWLe2ANe received SUBACK
Sat Nov 19 23:41:00 2022 kern.info quectel-CM[1449]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:41:00 2022 kern.info quectel-CM[1449]: Dail Failed 18
Sat Nov 19 23:41:05 2022 kern.info quectel-CM[1449]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:41:05 2022 kern.info quectel-CM[1449]: Dail Failed 19
Sat Nov 19 23:41:10 2022 user.err basicstation[2101]: [TCE:ERRO] TC connect failed - URI: wss://<redacted>.lns.lorawan.us-east-1.amazonaws.com:443
Sat Nov 19 23:41:11 2022 kern.info quectel-CM[1449]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:41:11 2022 kern.info quectel-CM[1449]: Dail Failed 20
Sat Nov 19 23:41:16 2022 kern.info quectel-CM[1449]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:41:16 2022 kern.info quectel-CM[1449]: Dail Failed 21
Sat Nov 19 23:41:21 2022 kern.info quectel-CM[1449]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:41:21 2022 kern.info quectel-CM[1449]: Dail Failed 22
Sat Nov 19 23:41:26 2022 kern.info quectel-CM[1449]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:41:26 2022 kern.info quectel-CM[1449]: Dail Failed 23
Sat Nov 19 23:41:31 2022 kern.info quectel-CM[1449]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:41:31 2022 kern.info quectel-CM[1449]: Dail Failed 24
Sat Nov 19 23:41:36 2022 kern.info quectel-CM[1449]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:41:36 2022 kern.info quectel-CM[1449]: Dail Failed 25
Sat Nov 19 23:41:41 2022 kern.info quectel-CM[1449]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:41:41 2022 kern.info quectel-CM[1449]: Dail Failed 26
Sat Nov 19 23:41:42 2022 kern.info quectel-CM[1449]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:41:46 2022 kern.info quectel-CM[1449]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:41:46 2022 kern.info quectel-CM[1449]: Dail Failed 27
Sat Nov 19 23:41:49 2022 user.err wisdm[5563]:  failed   ! mbedtls_net_connect returned -0x52
Sat Nov 19 23:41:51 2022 kern.info quectel-CM[1449]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:41:51 2022 kern.info quectel-CM[1449]: Dail Failed 28
Sat Nov 19 23:41:56 2022 user.notice data-broker: [16] Client mosq-7k231Tz1bzwWLe2ANe sending PINGREQ
Sat Nov 19 23:41:56 2022 kern.info quectel-CM[1449]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:41:56 2022 kern.info quectel-CM[1449]: Dail Failed 29
Sat Nov 19 23:41:56 2022 user.notice data-broker: [16] Client mosq-7k231Tz1bzwWLe2ANe received PINGRESP
Sat Nov 19 23:41:57 2022 kern.info quectel-CM[1449]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:42:00 2022 user.err basicstation[2101]: [TCE:ERRO] TC connect failed - URI: wss://<redacted>.lns.lorawan.us-east-1.amazonaws.com:443
Sat Nov 19 23:42:01 2022 kern.info quectel-CM[1449]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:42:01 2022 kern.info quectel-CM[1449]: Dail Failed 30
Sat Nov 19 23:42:06 2022 kern.info quectel-CM[1449]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:42:06 2022 kern.info quectel-CM[1449]: Dail Failed 31
Sat Nov 19 23:42:11 2022 kern.info quectel-CM[1449]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:42:11 2022 kern.info quectel-CM[1449]: Dail Failed 32
Sat Nov 19 23:42:12 2022 kern.info quectel-CM[1449]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:42:16 2022 kern.info quectel-CM[1449]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:42:16 2022 kern.info quectel-CM[1449]: Dail Failed 33
Sat Nov 19 23:42:16 2022 kern.info quectel-CM[1449]: QmiWwanThread exit
Sat Nov 19 23:42:16 2022 kern.info quectel-CM[1449]: main exit
Sat Nov 19 23:42:18 2022 kern.info quectel-CM[28993]: WCDMA&LTE_QConnectManager_Linux&Android_V1.1.38
Sat Nov 19 23:42:18 2022 kern.info quectel-CM[28993]: /usr/sbin/quectel profile[1] = super///0, pincode = (null)
Sat Nov 19 23:42:19 2022 user.notice root: echo 1 > /sys/class/gpio/gpio42/value
Sat Nov 19 23:42:19 2022 kern.info kernel: [178535.120000] usb 1-1: USB disconnect, device number 3
Sat Nov 19 23:42:19 2022 kern.info kernel: [178535.130000] option1 ttyUSB0: GSM modem (1-port) converter now disconnected from ttyUSB0
Sat Nov 19 23:42:19 2022 kern.info kernel: [178535.150000] option 1-1:1.0: device disconnected
Sat Nov 19 23:42:19 2022 kern.info kernel: [178535.160000] option1 ttyUSB1: GSM modem (1-port) converter now disconnected from ttyUSB1
Sat Nov 19 23:42:19 2022 kern.info kernel: [178535.170000] option 1-1:1.1: device disconnected
Sat Nov 19 23:42:19 2022 kern.info kernel: [178535.180000] option1 ttyUSB2: GSM modem (1-port) converter now disconnected from ttyUSB2
Sat Nov 19 23:42:19 2022 kern.info kernel: [178535.200000] option 1-1:1.2: device disconnected
Sat Nov 19 23:42:19 2022 kern.info kernel: [178535.210000] option1 ttyUSB3: GSM modem (1-port) converter now disconnected from ttyUSB3
Sat Nov 19 23:42:19 2022 kern.info kernel: [178535.220000] option 1-1:1.3: device disconnected
Sat Nov 19 23:42:19 2022 kern.info kernel: [178535.260000] qmi_wwan 1-1:1.4 wwan0: unregister 'qmi_wwan' usb-101c0000.ehci-1, WWAN/QMI device
Sat Nov 19 23:42:20 2022 daemon.notice netifd: Network device 'wwan0' link is down
Sat Nov 19 23:42:20 2022 daemon.notice netifd: Interface 'wwan' has link connectivity loss
Sat Nov 19 23:42:20 2022 daemon.notice netifd: Interface 'wwan6' has link connectivity loss
Sat Nov 19 23:42:20 2022 daemon.notice netifd: wwan (20903): Read error: Network is down, reopening socket
Sat Nov 19 23:42:20 2022 user.notice root: echo 0 > /sys/class/gpio/gpio42/value
Sat Nov 19 23:42:21 2022 user.notice hotplug: Cannot find LORA usb proper mapping, exit
Sat Nov 19 23:42:21 2022 daemon.notice netifd: wwan (20903): udhcpc: bind: No such device
Sat Nov 19 23:42:21 2022 daemon.notice netifd: Interface 'wwan' is now down
Sat Nov 19 23:42:21 2022 daemon.notice netifd: Interface 'wwan6' is now down
Sat Nov 19 23:42:22 2022 user.notice hotplug: Cannot find LORA usb proper mapping, exit
Sat Nov 19 23:42:22 2022 user.notice hotplug: Cannot find LORA usb proper mapping, exit
Sat Nov 19 23:42:23 2022 user.notice hotplug: Cannot find LORA usb proper mapping, exit
Sat Nov 19 23:42:23 2022 user.notice hotplug: Cannot find LORA usb proper mapping, exit
Sat Nov 19 23:42:24 2022 user.notice hotplug: Cannot find LORA usb proper mapping, exit
Sat Nov 19 23:42:26 2022 daemon.notice netifd: Interface 'wwan' is disabled
Sat Nov 19 23:42:26 2022 daemon.notice netifd: Interface 'wwan6' is disabled
Sat Nov 19 23:42:34 2022 kern.info kernel: [178549.980000] usb 1-1: new high-speed USB device number 4 using ehci-platform
Sat Nov 19 23:42:35 2022 kern.debug kernel: [178550.170000] usb 1-1: no of_node; not parsing pinctrl DT
Sat Nov 19 23:42:35 2022 kern.debug kernel: [178550.170000] option 1-1:1.0: no of_node; not parsing pinctrl DT
Sat Nov 19 23:42:35 2022 kern.info kernel: [178550.170000] option 1-1:1.0: GSM modem (1-port) converter detected
Sat Nov 19 23:42:35 2022 kern.debug kernel: [178550.180000] option1 ttyUSB0: no of_node; not parsing pinctrl DT
Sat Nov 19 23:42:35 2022 kern.info kernel: [178550.180000] usb 1-1: GSM modem (1-port) converter now attached to ttyUSB0
Sat Nov 19 23:42:35 2022 kern.debug kernel: [178550.200000] option 1-1:1.1: no of_node; not parsing pinctrl DT
Sat Nov 19 23:42:35 2022 kern.info kernel: [178550.200000] option 1-1:1.1: GSM modem (1-port) converter detected
Sat Nov 19 23:42:35 2022 kern.debug kernel: [178550.210000] option1 ttyUSB1: no of_node; not parsing pinctrl DT
Sat Nov 19 23:42:35 2022 kern.info kernel: [178550.210000] usb 1-1: GSM modem (1-port) converter now attached to ttyUSB1
Sat Nov 19 23:42:35 2022 kern.debug kernel: [178550.220000] option 1-1:1.2: no of_node; not parsing pinctrl DT
Sat Nov 19 23:42:35 2022 kern.info kernel: [178550.220000] option 1-1:1.2: GSM modem (1-port) converter detected
Sat Nov 19 23:42:35 2022 kern.debug kernel: [178550.230000] option1 ttyUSB2: no of_node; not parsing pinctrl DT
Sat Nov 19 23:42:35 2022 kern.info kernel: [178550.240000] usb 1-1: GSM modem (1-port) converter now attached to ttyUSB2
Sat Nov 19 23:42:35 2022 kern.debug kernel: [178550.250000] option 1-1:1.3: no of_node; not parsing pinctrl DT
Sat Nov 19 23:42:35 2022 kern.info kernel: [178550.250000] option 1-1:1.3: GSM modem (1-port) converter detected
Sat Nov 19 23:42:35 2022 kern.debug kernel: [178550.260000] option1 ttyUSB3: no of_node; not parsing pinctrl DT
Sat Nov 19 23:42:35 2022 kern.info kernel: [178550.260000] usb 1-1: GSM modem (1-port) converter now attached to ttyUSB3
Sat Nov 19 23:42:35 2022 kern.debug kernel: [178550.280000] qmi_wwan 1-1:1.4: no of_node; not parsing pinctrl DT
Sat Nov 19 23:42:35 2022 kern.info kernel: [178550.310000] qmi_wwan 1-1:1.4: cdc-wdm0: USB WDM device
Sat Nov 19 23:42:35 2022 kern.info kernel: [178550.320000] qmi_wwan 1-1:1.4: QuectelEC25&EC21&EG91&EG95&EG06&EP06&EM06&BG96&AG35 work on RawIP mode
Sat Nov 19 23:42:35 2022 kern.info kernel: [178550.340000] qmi_wwan 1-1:1.4 wwan0: register 'qmi_wwan' at usb-101c0000.ehci-1, WWAN/QMI device, 76:8f:b7:44:48:82
Sat Nov 19 23:42:35 2022 daemon.notice netifd: Interface 'wwan' is enabled
Sat Nov 19 23:42:35 2022 daemon.notice netifd: Interface 'wwan6' is enabled
Sat Nov 19 23:42:35 2022 daemon.notice netifd: Network device 'wwan0' link is up
Sat Nov 19 23:42:35 2022 daemon.notice netifd: Interface 'wwan' has link connectivity
Sat Nov 19 23:42:35 2022 daemon.notice netifd: Interface 'wwan' is setting up now
Sat Nov 19 23:42:35 2022 daemon.notice netifd: Interface 'wwan6' has link connectivity
Sat Nov 19 23:42:35 2022 daemon.notice netifd: Interface 'wwan6' is setting up now
Sat Nov 19 23:42:35 2022 user.notice hotplug: Cannot find LORA usb proper mapping, exit
Sat Nov 19 23:42:35 2022 daemon.notice netifd: wwan (29831): udhcpc: option -h NAME is deprecated, use -x hostname:NAME
Sat Nov 19 23:42:35 2022 daemon.notice netifd: wwan (29831): udhcpc (v1.23.2) started
Sat Nov 19 23:42:35 2022 daemon.notice netifd: wwan (29831): Sending discover...
Sat Nov 19 23:42:35 2022 user.notice hotplug: Cannot find LORA usb proper mapping, exit
Sat Nov 19 23:42:36 2022 user.notice hotplug: Cannot find LORA usb proper mapping, exit
Sat Nov 19 23:42:36 2022 user.notice hotplug: Cannot find LORA usb proper mapping, exit
Sat Nov 19 23:42:36 2022 user.notice hotplug: Cannot find LORA usb proper mapping, exit
Sat Nov 19 23:42:36 2022 user.notice hotplug: Cannot find LORA usb proper mapping, exit
Sat Nov 19 23:42:38 2022 daemon.notice netifd: wwan (29831): Sending discover...
Sat Nov 19 23:42:41 2022 daemon.notice netifd: wwan (29831): Sending discover...
Sat Nov 19 23:42:46 2022 kern.info quectel-CM[28993]: Find /sys/bus/usb/devices/1-1 idVendor=2c7c idProduct=0195
Sat Nov 19 23:42:46 2022 kern.info quectel-CM[28993]: Find /sys/bus/usb/devices/1-1:1.4/net/wwan0
Sat Nov 19 23:42:46 2022 kern.info quectel-CM[28993]: Find usbnet_adapter = wwan0
Sat Nov 19 23:42:46 2022 kern.info quectel-CM[28993]: Find /sys/bus/usb/devices/1-1:1.4/usbmisc/cdc-wdm0
Sat Nov 19 23:42:46 2022 kern.info quectel-CM[28993]: Find qmichannel = /dev/cdc-wdm0
Sat Nov 19 23:42:46 2022 kern.info quectel-CM[28993]: cdc_wdm_fd = 7
Sat Nov 19 23:42:46 2022 kern.info quectel-CM[28993]: Get clientWDS = 20
Sat Nov 19 23:42:46 2022 kern.info quectel-CM[28993]: Get clientDMS = 1
Sat Nov 19 23:42:46 2022 kern.info quectel-CM[28993]: Get clientNAS = 4
Sat Nov 19 23:42:46 2022 kern.info quectel-CM[28993]: Get clientUIM = 1
Sat Nov 19 23:42:46 2022 kern.info quectel-CM[28993]: Get clientWDA = 1
Sat Nov 19 23:42:46 2022 kern.info quectel-CM[28993]: requestBaseBandVersion EG95NAFBR05A04M4G
Sat Nov 19 23:42:46 2022 kern.info quectel-CM[28993]: requestGetSIMStatus SIMStatus: SIM_READY
Sat Nov 19 23:42:46 2022 kern.info quectel-CM[28993]: requestGetICCID DeviceICCID: 89883070000029574306
Sat Nov 19 23:42:46 2022 kern.info quectel-CM[28993]: requestGetIMSI DeviceIMSI: 234104869173506
Sat Nov 19 23:42:46 2022 kern.info quectel-CM[28993]: requestSetProfile[1] super///0
Sat Nov 19 23:42:47 2022 kern.info quectel-CM[28993]: requestGetProfile[1] super///0
Sat Nov 19 23:42:47 2022 kern.info quectel-CM[28993]: requestRegistrationState2 MCC: 0, MNC: 0, PS: Detached, DataCap: UNKNOW
Sat Nov 19 23:42:47 2022 kern.info quectel-CM[28993]: requestQueryDataCall IPv4ConnectionStatus: DISCONNECTED
Sat Nov 19 23:42:47 2022 kern.info quectel-CM[28993]: requestRegistrationState2 MCC: 0, MNC: 0, PS: Detached, DataCap: UNKNOW
Sat Nov 19 23:42:47 2022 kern.info quectel-CM[28993]: Dail Failed 1
Sat Nov 19 23:42:49 2022 kern.info quectel-CM[28993]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:42:49 2022 kern.info quectel-CM[28993]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:42:49 2022 kern.info quectel-CM[28993]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:42:49 2022 kern.info quectel-CM[28993]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:42:50 2022 kern.info quectel-CM[28993]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:42:50 2022 kern.info quectel-CM[28993]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:42:52 2022 kern.info quectel-CM[28993]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:42:52 2022 kern.info quectel-CM[28993]: Dail Failed 2
Sat Nov 19 23:42:55 2022 user.notice data-broker: [16] Client mosq-7k231Tz1bzwWLe2ANe sending PINGREQ
Sat Nov 19 23:42:55 2022 user.notice data-broker: [16] Client mosq-7k231Tz1bzwWLe2ANe received PINGRESP
Sat Nov 19 23:42:57 2022 kern.info quectel-CM[28993]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:42:57 2022 kern.info quectel-CM[28993]: Dail Failed 3
Sat Nov 19 23:43:00 2022 user.err basicstation[2101]: [TCE:ERRO] TC connect failed - URI: wss://A2NOSFGOHJYZHU.lns.lorawan.us-east-1.amazonaws.com:443
Sat Nov 19 23:43:02 2022 kern.info quectel-CM[28993]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:43:02 2022 kern.info quectel-CM[28993]: Dail Failed 4
Sat Nov 19 23:43:05 2022 kern.info quectel-CM[28993]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:43:06 2022 kern.info quectel-CM[28993]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:43:07 2022 kern.info quectel-CM[28993]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:43:07 2022 kern.info quectel-CM[28993]: Dail Failed 5
Sat Nov 19 23:43:12 2022 kern.info quectel-CM[28993]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:43:12 2022 kern.info quectel-CM[28993]: Dail Failed 6
Sat Nov 19 23:43:15 2022 kern.info quectel-CM[28993]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:43:17 2022 kern.info quectel-CM[28993]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:43:17 2022 kern.info quectel-CM[28993]: Dail Failed 7
Sat Nov 19 23:43:19 2022 kern.info quectel-CM[28993]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:43:20 2022 kern.info quectel-CM[28993]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:43:22 2022 kern.info quectel-CM[28993]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:43:22 2022 kern.info quectel-CM[28993]: Dail Failed 8
Sat Nov 19 23:43:27 2022 kern.info quectel-CM[28993]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:43:27 2022 kern.info quectel-CM[28993]: Dail Failed 9
Sat Nov 19 23:43:32 2022 kern.info quectel-CM[28993]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:43:32 2022 kern.info quectel-CM[28993]: Dail Failed 10
Sat Nov 19 23:43:37 2022 kern.info quectel-CM[28993]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:43:37 2022 kern.info quectel-CM[28993]: Dail Failed 11
Sat Nov 19 23:43:42 2022 kern.info quectel-CM[28993]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:43:42 2022 kern.info quectel-CM[28993]: Dail Failed 12
Sat Nov 19 23:43:47 2022 kern.info quectel-CM[28993]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:43:47 2022 kern.info quectel-CM[28993]: Dail Failed 13
Sat Nov 19 23:43:51 2022 kern.info quectel-CM[28993]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:43:52 2022 kern.info quectel-CM[28993]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:43:52 2022 kern.info quectel-CM[28993]: Dail Failed 14
Sat Nov 19 23:43:55 2022 user.notice data-broker: data-broker timeout, restart it
Sat Nov 19 23:43:57 2022 user.err wisdm[5563]:  failed   ! mbedtls_net_connect returned -0x52
Sat Nov 19 23:43:57 2022 user.err wisdm[5563]: An error occurred in the loop -14
Sat Nov 19 23:43:57 2022 user.info wisdm[5563]: Disconnecting
Sat Nov 19 23:43:57 2022 user.err wisdm[5563]: Disconnect error -13
Sat Nov 19 23:43:58 2022 kern.info quectel-CM[28993]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:43:58 2022 kern.info quectel-CM[28993]: Dail Failed 15
Sat Nov 19 23:43:59 2022 user.info wisdm[1733]: AWS IoT SDK Version 3.0.1-
Sat Nov 19 23:43:59 2022 user.info wisdm[1733]: WisDM Agent Version 1.1.1
Sat Nov 19 23:43:59 2022 user.info wisdm[1733]: ThingName <redacted>
Sat Nov 19 23:44:00 2022 user.notice data-broker: {"60000":{"mqtt":{"keepalive":"10","clean_session":"1","broker_port":"8883","broker_ip":"mq.kritto.net","username":"gateway-pub","tls_version":"tlsv1.2","version":"3.1.1","tls_mode":"ca_signed","auth_enable":"1","password":"<redacted>","qos":"1","retain":"0"}}}
Sat Nov 19 23:44:00 2022 user.notice data-broker: [16] Client mosq-S2wZkg3Xs6dsjGYYX9 sending CONNECT
Sat Nov 19 23:44:00 2022 user.notice data-broker: [16] Client mosq-S2wZkg3Xs6dsjGYYX9 received CONNACK (0)
Sat Nov 19 23:44:00 2022 user.notice data-broker: subscribe: loranet/application/60000/device/#
Sat Nov 19 23:44:00 2022 user.notice data-broker: [16] Client mosq-S2wZkg3Xs6dsjGYYX9 sending SUBSCRIBE (Mid: 1, Topic: loranet/application/60000/device/#, QoS: 2, Options: 0x00)
Sat Nov 19 23:44:00 2022 user.err basicstation[2101]: [TCE:ERRO] TC connect failed - URI: wss://<redacted>.lns.lorawan.us-east-1.amazonaws.com:443
Sat Nov 19 23:44:00 2022 user.notice data-broker: [16] Client mosq-S2wZkg3Xs6dsjGYYX9 received SUBACK
Sat Nov 19 23:44:01 2022 user.info wisdm[1733]: Shadow Init
Sat Nov 19 23:44:01 2022 user.info wisdm[1733]: Succesfully connected to local MQTT broker!
Sat Nov 19 23:44:01 2022 user.err wisdm[1733]:  failed   ! mbedtls_net_connect returned -0x52
Sat Nov 19 23:44:01 2022 user.err wisdm[1733]: Shadow Connection Error
Sat Nov 19 23:44:01 2022 user.info wisdm[1733]: Disconnecting
Sat Nov 19 23:44:01 2022 user.err wisdm[1733]: Disconnect error -13
Sat Nov 19 23:44:03 2022 kern.info quectel-CM[28993]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:44:03 2022 kern.info quectel-CM[28993]: Dail Failed 16
Sat Nov 19 23:44:03 2022 user.info wisdm[1993]: AWS IoT SDK Version 3.0.1-
Sat Nov 19 23:44:03 2022 user.info wisdm[1993]: WisDM Agent Version 1.1.1
Sat Nov 19 23:44:03 2022 user.info wisdm[1993]: ThingName <redacted>
Sat Nov 19 23:44:04 2022 user.info wisdm[1993]: Shadow Init
Sat Nov 19 23:44:04 2022 user.info wisdm[1993]: Succesfully connected to local MQTT broker!
Sat Nov 19 23:44:04 2022 user.err wisdm[1993]:  failed   ! mbedtls_net_connect returned -0x52
Sat Nov 19 23:44:04 2022 user.err wisdm[1993]: Shadow Connection Error
Sat Nov 19 23:44:04 2022 user.info wisdm[1993]: Disconnecting
Sat Nov 19 23:44:04 2022 user.err wisdm[1993]: Disconnect error -13
Sat Nov 19 23:44:06 2022 kern.info quectel-CM[28993]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:44:06 2022 user.info wisdm[2234]: AWS IoT SDK Version 3.0.1-
Sat Nov 19 23:44:06 2022 user.info wisdm[2234]: WisDM Agent Version 1.1.1
Sat Nov 19 23:44:06 2022 user.info wisdm[2234]: ThingName <redacted>
Sat Nov 19 23:44:08 2022 kern.info quectel-CM[28993]: requestRegistrationState2 MCC: 302, MNC: 220, PS: Detached, DataCap: UMTS
Sat Nov 19 23:44:08 2022 kern.info quectel-CM[28993]: Dail Failed 17

and then it repeatedly fails the Shadow Init.

We can sometimes get it to reconnect by unplugging and plugging it back in.
Sometimes re-inserting the SIM card works.
Sometimes switching to a different SIM card works.

This device was running firmware 1.3.3_RAK b100.

[Martin (Martin Manolov)]

Hello @trisapeace,

We suspect what the issue might be. Can you add the gateways in WisDM (if they are not added already) and provide Temporary access to the Organization (for example for a week) so we can have a look at the gateways via SSH?
Ping me when you have done that. Thanks!

[trisapeace (Theresa D)]

Hi @Martin ,

This gateway is not currently in WisDM. I am actually trying to set that up right now. Once I have that up and running, I’ll let you know.

What is it that you suspect? Is there anything that I can check manually on my side in the meantime?

Thank you!

[LasseRegin]

We are experiencing similar issues. Did you ever identify the problem?

[trisapeace (Theresa D)]

Hi @LasseRegin ,

We have not (yet) identified the problem, but we have noticed that it has gotten less frequent in the last couple of months.

We added a cron job that tries to ping 8.8.8.8 every hour and if there is no response, then it restarts the Gateway. This has helped in some instances, but actually it just seems to lose connection less often now than when I first posted about this.