{"id":1355,"date":"2024-05-22T14:31:16","date_gmt":"2024-05-22T14:31:16","guid":{"rendered":"https:\/\/adrianotanaka.com.br\/?p=1355"},"modified":"2024-05-22T21:00:54","modified_gmt":"2024-05-22T21:00:54","slug":"goldengate-23ai-with-asyncapi","status":"publish","type":"post","link":"https:\/\/adrianotanaka.com.br\/index.php\/2024\/05\/22\/goldengate-23ai-with-asyncapi\/","title":{"rendered":"GoldenGate 23ai with Data Stream and AsyncAPI"},"content":{"rendered":"\n

GoldenGate 23ai introduces a powerful new feature called Data Streams, which leverages the AsyncAPI specification and you publish your trail file directly from GoldenGate(and you can specify the CloudEvents format), according to the documentation:<\/p>\n\n\n\n

\n

Oracle GoldenGate Data Streams utilizes the AsyncAPI specification for defining asynchronous APIs. This approach enables applications to efficiently subscribe to data streams using a Publish or Subscribe model. <\/p>\n\n\n\n

About Data Streams (oracle.com)<\/a><\/p>\n<\/blockquote>\n\n\n\n

It was hard to me to understand the concept behind this but with the release of GoldenGate 23ai I had some time to play with it and here are my considerations.<\/p>\n\n\n\n

Producer<\/h2>\n\n\n\n

My producer is an extract capturing data from my 19c database, and here you don’t need anything special:<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n
\"\"<\/figure>\n\n\n\n

<\/p>\n\n\n\n

After your extract is up and running, go to Distribution Service > Data Streams and create a new one selecting your trail file<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n
\"\"<\/figure>\n\n\n\n

You can also apply some filters <\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Now that your Data Stream is up, the AsyncApi shows its power, all the specs are there to understand what you can do and what are the format available , the Data Stream reads the trail and publish it (using wss protocol).<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

In my case I’ve created some “endpoints”, each one to expose an specific operation type:<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Consumer\/Subscribe<\/h2>\n\n\n\n

For the Consumer side I’m using the websocat<\/a>, after the download you can run it from the command line with this syntax:<\/p>\n\n\n\n

.\/websocat.x86_64 wss:\/\/USER:'PASSWORD'@SERVER:9102\/services\/v2\/stream\/DATA_STREAM_NAME<\/code><\/pre>\n\n\n\n
In my case I had to use the -k parameter to ignore the certificate:<\/p>\n\n\n\n
.\/websocat.x86_64 wss:\/\/USER:'PASSWORD'@SERVER:9102\/services\/v2\/stream\/myExample?begin=earliest -k\n<\/code><\/pre>\n\n\n\n
Now my application can subscribe to the endpoints.<\/p>\n\n\n\n
If I would like to consume only the inserts:<\/p>\n\n\n\n
.\/websocat.x86_64 wss:\/\/USER:'PASSWORD'@SERVER:9102\/services\/v2\/stream\/dsINSERT?begin=earliest -k -v -S | jq -r<\/code><\/pre>\n\n\n\n
\"\"<\/figure>\n\n\n\n
And if i need to get only the updates<\/p>\n\n\n\n
.\/websocat.x86_64 wss:\/\/USER:'PASSWORD'@SERVER:9102\/services\/v2\/stream\/dsUPDATE?begin=earliest -k -v -S | jq -r<\/code><\/pre>\n\n\n\n
\"\"<\/figure>\n\n\n\n
Conclusion<\/h2>\n\n\n\n
If your goal was to share your data in json format you can move from this:<\/p>\n\n\n\n
\"\"<\/figure>\n\n\n\n
To this:<\/p>\n\n\n\n
\"\"<\/figure>\n\n\n\n
As usual, there is no silver bullet, each project has specific details, but with this new option, your application\/consumer\/subscriber can go closer to the producer to get the data.<\/p>\n","protected":false},"excerpt":{"rendered":"
GoldenGate 23ai introduces a powerful new feature called Data Streams, which leverages the AsyncAPI specification and you publish your trail file directly from GoldenGate(and you can specify the CloudEvents format), according to the documentation: Oracle GoldenGate Data Streams utilizes the AsyncAPI specification for defining asynchronous APIs. This approach enables applications to efficiently subscribe to data […]<\/p>\n","protected":false},"author":1,"featured_media":1375,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"material-hide-sections":[],"footnotes":""},"categories":[55,48,8,6],"tags":[],"class_list":["post-1355","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-api","category-goldengate","category-oci","category-oracle"],"_links":{"self":[{"href":"https:\/\/adrianotanaka.com.br\/index.php\/wp-json\/wp\/v2\/posts\/1355","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/adrianotanaka.com.br\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/adrianotanaka.com.br\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/adrianotanaka.com.br\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/adrianotanaka.com.br\/index.php\/wp-json\/wp\/v2\/comments?post=1355"}],"version-history":[{"count":15,"href":"https:\/\/adrianotanaka.com.br\/index.php\/wp-json\/wp\/v2\/posts\/1355\/revisions"}],"predecessor-version":[{"id":1391,"href":"https:\/\/adrianotanaka.com.br\/index.php\/wp-json\/wp\/v2\/posts\/1355\/revisions\/1391"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/adrianotanaka.com.br\/index.php\/wp-json\/wp\/v2\/media\/1375"}],"wp:attachment":[{"href":"https:\/\/adrianotanaka.com.br\/index.php\/wp-json\/wp\/v2\/media?parent=1355"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/adrianotanaka.com.br\/index.php\/wp-json\/wp\/v2\/categories?post=1355"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/adrianotanaka.com.br\/index.php\/wp-json\/wp\/v2\/tags?post=1355"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}