Missing Pub/Sub providor - AWS IoT

I am following this document to create an AWS IoT connection from an application we have created.

I have got to the stage where we need to create a new Pub/Sub Integration but when i click on Add the document suggests i should have three providers, NATS / MQTT and AWS IoT.

We seem to be missing the AWS IoT option.

I’m not sure if this is due to us running version 3.8.4. I have asked in another thread how we do about updating to 3.9.

Are we missing the option due to a version difference or does it need to be added elsewhere ?

Hi @Pigsfoot, the AWS IoT integration is indeed new in The Things Enterprise Stack 3.9. See my response to your other question about upgrading your deployment to 3.9.

@htdvisser , looks like i am not quite as far ahead as i had hoped.

When we followed the instructions for the deployment guide on the AWS IOT doc we received hundreds of error messages about IAM permissions issues.

https://enterprise.thethingsstack.io/integrations/aws-iot/default/deployment-guide/

As the cloud formation template was created when running version 3.8 of the server so i decided to delete it and start fresh. However since the upgrade to 3.9.1 we are unable to run the cloud formation template for the AWS IOT integration and keep getting the following error messages

2020-09-14 22:26:22 UTC+0100 Bosch-Parking-Sensor-IOT-Stack
ROLLBACK_IN_PROGRESS The following resource(s) failed to create: [ClaimThingFunctionServiceRoleDefaultPolicy7A5A6E1A, CreateThingTypeFunctionServiceRoleDefaultPolicy846D9B20, HandleDownlinkFunctionServiceRoleDefaultPolicy2B9D6C77, CreateThingRule, DeleteThingRule, Configuration, HandleUplinkFunctionServiceRoleDefaultPolicyF1A0596C]. . Rollback requested by user.
2020-09-14 22:26:21 UTC+0100 DeleteThingRule
CREATE_FAILED Resource creation cancelled
2020-09-14 22:26:21 UTC+0100 HandleUplinkFunctionServiceRoleDefaultPolicyF1A0596C
CREATE_FAILED Resource creation cancelled
2020-09-14 22:26:21 UTC+0100 HandleDownlinkFunctionServiceRoleDefaultPolicy2B9D6C77
CREATE_FAILED Resource creation cancelled
2020-09-14 22:26:21 UTC+0100 CreateThingTypeFunctionServiceRoleDefaultPolicy846D9B20
CREATE_FAILED Resource creation cancelled
2020-09-14 22:26:21 UTC+0100 CreateThingRule
CREATE_FAILED Resource creation cancelled
2020-09-14 22:26:21 UTC+0100 ClaimThingFunctionServiceRoleDefaultPolicy7A5A6E1A
CREATE_FAILED Resource creation cancelled
2020-09-14 22:26:20 UTC+0100 Configuration
CREATE_FAILED Failed to create resource. Enable AWS IoT pub/sub integration: rpc error: code = PermissionDenied desc = error:pkg/auth/rights:insufficient_application_rights (insufficient rights for application bosch-parking-sensor@things-enterprise-stack-srv)

The template then roll’s back… do you have any idea’s.

I have tried both self hosted and cloud hosted templates although as we are hosting everything at AWS i’m sure the cloud hosted template is the correct one.

Looping in @johan here, since he’s the expert on the AWS IoT integration.

This is a mismatch between versions, apologies for that.

Please add the “edit basic application settings” right to the API key and try again.

Hi @johan, thanks for the reply.

Just added the extra right to the API key, and ran the cloud formation template again and still getting the same error.

2020-09-15 08:50:13 UTC+0100 bosch-parking-sensor-aws-iot-stack
ROLLBACK_IN_PROGRESS The following resource(s) failed to create: [ClaimThingFunctionServiceRoleDefaultPolicy7A5A6E1A, CreateThingTypeFunctionServiceRoleDefaultPolicy846D9B20, HandleDownlinkFunctionServiceRoleDefaultPolicy2B9D6C77, CreateThingRule, DeleteThingRule, Configuration, HandleUplinkFunctionServiceRoleDefaultPolicyF1A0596C]. . Rollback requested by user.
2020-09-15 08:50:12 UTC+0100 DeleteThingRule
CREATE_FAILED Resource creation cancelled
2020-09-15 08:50:12 UTC+0100 HandleUplinkFunctionServiceRoleDefaultPolicyF1A0596C
CREATE_FAILED Resource creation cancelled
2020-09-15 08:50:12 UTC+0100 CreateThingTypeFunctionServiceRoleDefaultPolicy846D9B20
CREATE_FAILED Resource creation cancelled
2020-09-15 08:50:12 UTC+0100 ClaimThingFunctionServiceRoleDefaultPolicy7A5A6E1A
CREATE_FAILED Resource creation cancelled
2020-09-15 08:50:12 UTC+0100 CreateThingRule
CREATE_FAILED Resource creation cancelled
2020-09-15 08:50:12 UTC+0100 HandleDownlinkFunctionServiceRoleDefaultPolicy2B9D6C77
CREATE_FAILED Resource creation cancelled
2020-09-15 08:50:12 UTC+0100 Configuration
CREATE_FAILED Failed to create resource. Enable AWS IoT pub/sub integration: rpc error: code = InvalidArgument desc = error:pkg/errors:validation (invalid ids: embedded message failed validation)

Can i just check that i should be using the “Deploy for Cloud Hosted” template.

Also, might be worth noting the API was created when on server version 3.8. Should i delete and recreate it ?

Getting there. Probably something we should fix. What is the Stack Name and the Application ID? You can dm me if that is sensitive info.

H i @johan, sent you a PM with the details request. Thanks

1 Like

Issue identified and fixed in v0.13