End device join issue

TTN Network and Services The Things Stack v3
1

Hello Everybody,
Some devices are not able to join to LBS.
Sometimes I see this kind of messages on device live data:

{
  "name": "ns.down.data.schedule.fail",
  "time": "2023-08-25T07:26:29.329613338Z",
  "identifiers": [
    {
      "device_ids": {
        "device_id": "XXXXX",
        "application_ids": {
          "application_id": "XXXXX"
        },
        "dev_eui": "XXXXX",
        "join_eui": "XXXXX",
        "dev_addr": "XXXXX"
      }
    }
  ],
  "data": {
    "@type": "type.googleapis.com/ttn.lorawan.v3.ErrorDetails",
    "namespace": "pkg/gatewayserver",
    "name": "schedule",
    "message_format": "failed to schedule",
    "correlation_id": "41853a3e98b24fe5a323f7494cd72f24",
    "code": 10,
    "details": [
      {
        "@type": "type.googleapis.com/ttn.lorawan.v3.ScheduleDownlinkErrorDetails",
        "path_errors": [
          {
            "namespace": "pkg/gatewayserver",
            "name": "schedule_path",
            "message_format": "failed to schedule on path `{gateway_uid}`",
            "attributes": {
              "gateway_uid": "XXXXX"
            },
            "correlation_id": "9eb77f1af846431f906fb7799772fcd1",
            "cause": {
              "namespace": "pkg/gatewayserver/io",
              "name": "tx_schedule",
              "message_format": "failed to schedule",
              "correlation_id": "ef8bed1359df40dd994f6b319f19a8c5",
              "code": 10,
              "details": [
                {
                  "@type": "type.googleapis.com/ttn.lorawan.v3.ScheduleDownlinkErrorDetails",
                  "path_errors": [
                    {
                      "namespace": "pkg/gatewayserver/io",
                      "name": "rx_window_schedule",
                      "message_format": "schedule in Rx window `{window}` failed",
                      "attributes": {
                        "window": 1
                      },
                      "correlation_id": "13d3f5d86ca34c16b21222c3475093e1",
                      "cause": {
                        "namespace": "pkg/gatewayserver/scheduling",
                        "name": "blocked",
                        "message_format": "sub band is blocked for `{duration}`",
                        "attributes": {
                          "duration": "1.823496s"
                        },
                        "correlation_id": "51c9282c390145bd8d47e492eb1a0c66",
                        "code": 8
                      },
                      "code": 8
                    },
                    {
                      "namespace": "pkg/gatewayserver/io",
                      "name": "rx_window_schedule",
                      "message_format": "schedule in Rx window `{window}` failed",
                      "attributes": {
                        "window": 2
                      },
                      "correlation_id": "f84fc0e5002a41f0a65999c8e5e46bdc",
                      "cause": {
                        "namespace": "pkg/gatewayserver/scheduling",
                        "name": "blocked",
                        "message_format": "sub band is blocked for `{duration}`",
                        "attributes": {
                          "duration": "1.025416s"
                        },
                        "correlation_id": "888576f6574649e992b1a3399828cf37",
                        "code": 8
                      },
                      "code": 8
                    }
                  ]
                }
              ]
            },
            "code": 10,
            "details": [
              {
                "@type": "type.googleapis.com/ttn.lorawan.v3.ScheduleDownlinkErrorDetails",
                "path_errors": [
                  {
                    "namespace": "pkg/gatewayserver/io",
                    "name": "rx_window_schedule",
                    "message_format": "schedule in Rx window `{window}` failed",
                    "attributes": {
                      "window": 1
                    },
                    "correlation_id": "13d3f5d86ca34c16b21222c3475093e1",
                    "cause": {
                      "namespace": "pkg/gatewayserver/scheduling",
                      "name": "blocked",
                      "message_format": "sub band is blocked for `{duration}`",
                      "attributes": {
                        "duration": "1.823496s"
                      },
                      "correlation_id": "51c9282c390145bd8d47e492eb1a0c66",
                      "code": 8
                    },
                    "code": 8
                  },
                  {
                    "namespace": "pkg/gatewayserver/io",
                    "name": "rx_window_schedule",
                    "message_format": "schedule in Rx window `{window}` failed",
                    "attributes": {
                      "window": 2
                    },
                    "correlation_id": "f84fc0e5002a41f0a65999c8e5e46bdc",
                    "cause": {
                      "namespace": "pkg/gatewayserver/scheduling",
                      "name": "blocked",
                      "message_format": "sub band is blocked for `{duration}`",
                      "attributes": {
                        "duration": "1.025416s"
                      },
                      "correlation_id": "888576f6574649e992b1a3399828cf37",
                      "code": 8
                    },
                    "code": 8
                  }
                ]
              }
            ]
          }
        ]
      }
    ]
  },
  "correlation_ids": [
    "gs:conn:01H8KYBJMZMQG9Y17CV1NJXZ4Y",
    "gs:up:host:01H8KYBJN4SNC1AEAD6DN2WVJH",
    "gs:uplink:01H8NSCQ1K16QJKZ65Y909T9H2",
    "ns:downlink:01H8NSCQEFTDVG8M1APAS256WV",
    "ns:transmission:01H8NSCQEFMT0TSECKGMYZYDQC",
    "ns:uplink:01H8NSCQ1MKP7QEAPEZMXGXFMP",
    "rpc:/ttn.lorawan.v3.GsNs/HandleUplink:01H8NSCQ1MK1TTATB2SA3VRX2Z"
  ],
  "origin": "ip-10-23-14-92.eu-west-1.compute.internal",
  "context": {
    "tenant-id": "XXXX"
  },
  "visibility": {
    "rights": [
      "RIGHT_APPLICATION_TRAFFIC_READ"
    ]
  },
  "unique_id": "01H8NSCQEH60714J6PG3F449BP"
}

Any idea?

Thanks in advance

2

Suggests GW is being overloaded wrt its own TX activities - ie. downlinks blocked. Is this your own GW or do you have access to a shared resource? Eitherway suggests DL being requested far too often - how often are you uplinking? Are you using confirmed messages? (Hint dont!), Are you on a very active GW servicing lots of nodes all demanding (combined) lots of DL’s - join accepts, ack’s, MAC commands, FUOTA activity, etc.?

Tell us more about your set up and we might be able to help but mean time ensure/confirm here you are following FUP!

3

Did you READ the errors?

Too many devices requiring a downlink so the gateway runs out of airtime.

BTW, please use the tools in the formatting bar when pasting json/code. Improves readability of the message enormously.

4

Hi Jeff,
This is a private gateway the serves circa 30 devices and It uses basic station packet forwarder.
Devices send messages every 20 minutes, Is it too high as frequences?
We use confirmed messages for application downink essages only that are send for set some scheduled operations on 15 devices only. This kind of messages are very rare.

Thanks in advance.

5

Hi Kersing,
Thanks for suggestion, I’ll pay attentions on message formatting next time.

King Regards

6

And perhaps the content too??

Private as in you own it or is it on TTN thereby serving the local community devices?

Thirty devices sending once every 20 minutes is relatively low traffic. Confirmed downlinks are the very worst kind as you run the risk of ending up in a downlink loop which may well be the cause of your problems.

The downlink duration that runs to almost 2 seconds implies very large messages.

There is such a small amount of information here that it’s going to be hard to help - particularly region as that refers to the duty cycle / dwell time - plus hard data on size, SF and how often these downlinks are sent. Take a step back and consider what some random volunteers who know nothing about your install may need to be able to assist.

7

I’m terrible sorry, I’m newbie to lorawan.

Could you be so kind as to give me an example about information to provide?

es.

Region used: EU868 - SF9 for RX2
spreading_factor: SF7BW125
Downlink payload size: 11 bytes
Downlink frequency: I suppose 4 messege per node per week