3,143 questions
Tooling
0
votes
0
replies
67
views
Get Gmail Watch Status - which Pub sub topic is linked to it
In our application we have a functionality to configure push triggers for Gmail mailboxes. We are creating Gmail watch linked with a pub sub topic for it, and we have a functionality to delete the ...
Score of 0
1 answer
99 views
Can a Pub/Sub SMT (javascript UDF) act on protobuf encoded messages?
I have Pub/Sub subscription to a Pub/Sub topic that uses BINARY encoding and a PROTOCOL_BUFFER topic schema. The messages published there are encoded as protocol buffers (protobuf)
I wanted to write a ...
Score of 0
0 answers
103 views
Can I send a JSON object to BigQuery without stringifying it?
I am trying to figure out if there is a way to send a JSON object to a BigQuery table that has a column of type JSON. I know the current practice is to stringify the JSON and send it over which gets ...
Score of 0
1 answer
111 views
Google Pub/Sub push subscription to BigQuery changes value in float data type
I have a BigQuery push subscription in Pub/Sub that for some reason changes the values of the fields with float datatype when pushed to BigQuery.
I tried creating a pull subscription and attached it ...
Score of 0
0 answers
72 views
Google Pub/Sub — Publisher works, how do I confirm my subscriber is receiving/ACKing messages?
I’m working on a project that uses Flask as the publisher and a Python subscriber to handle messages with Google Cloud Pub/Sub.
My setup:
A local Flask front end publishes messages (itemID, location, ...
Score of 0
0 answers
108 views
Jest hangs when publishing to @google-cloud/pubsub in integration test
I have an integration test that publishes a domain event to Google Cloud Pub/Sub (using the Pub/Sub emulator). Eventduspatcher.integration.test.ts passes but Jest prints:
Jest did not exit one second ...
Score of 0
1 answer
140 views
Google Cloud PubSub Synchronous Pull: Getting One Message at a Time Instead of Batches
Problem
I'm using Google Cloud PubSub with synchronous pull and ordering enabled to consume messages from a Debezium Server setup, but I'm only receiving one message at a time instead of getting ...
Score of 0
0 answers
71 views
What connector can be used for Google Cloud pubsub along with Cloud dataproc ( Spark 3.5.x )
I am using Spark 3.5.x and would like to use readStream() API to read structured streaming using Java .
I don't see any pubsub connector available. Couldn't try pubsub lite because it is deprecated ...
Score of 0
1 answer
255 views
GCloud Pub/Sub Pull subscription limit of 5000 messages
Currently I am working on a project that publishes any received request contents to a pub sub topic and subsequent subscriber, in order to pull and batch process all of the messages at once every ...
Score of 0
0 answers
115 views
Google Cloud Run background worker cannot resolve Application Default Credentials for Pub/Sub (works locally)
I have a .NET 8 background worker running on Cloud Run.
The worker should publish messages to Pub/Sub, but I always get the following error at runtime:
System.InvalidOperationException: Your default ...
Score of 0
1 answer
111 views
Publish to @google-cloud/pubsub topic from Firebase sdk is failing
With all nodejs packages updated, trying to publish message to topic ends on timeout with error:
GoogleError: Total timeout of API google.pubsub.v1.Publisher exceeded. Error: Getting metadata from ...
Score of 1
0 answers
205 views
How to test connection to Google Pub/Sub when creating a client in Go using pubsub/v2?
I have a Go application, where I create a Pub/Sub client and then I create a subscriber receiving from a topic/subscription I've created locally using a local Docker gcloud emulator container. ...
Score of 4
3 answers
652 views
Backward and forward compatibility issues with protobufs in Google Pub/Sub
We use protocol buffers both for gRPC server-to-server communication and for publishing messages to Pub/Sub.
Pub/Sub is fairly sensitive to schema changes, not allowing any schema changes that would ...
Score of 1
1 answer
80 views
export data query executes successfully but messages are not pushed to pub/sub topic
I ran this standard query and it executes successfully.
EXPORT DATA
OPTIONS (
uri = 'https://pubsub.googleapis.com/projects/ggdevbigqueryproject/topics/GGTEST',
format = 'JSON',
...
Score of 0
0 answers
92 views
setting up a watch in pubsub from a google form
Does anyone know the best doc to follow for pulling data from a Google Form via Apps Script and sending that data to pubsub, been following this guide
https://developers.google.com/workspace/forms/api/...