A set of sensors post events to GCP Cloud pub/sub through MQTT protocol. If you are observing lots of duplicate messages in the Pub/Sub Topic, chances are that the endpoint ack is not arriving on time.
As per GCP docs – Duplicate messages in the topic could be because of delayed acknowledgements. If acknowledgement is not received before acknowledgement deadline then publisher will retry sending the same message.
Need a hands-on Data Architect, AI, ML or GCP Consultant?
Need help with your data journey? Start the conversation today.