Create accountLogin

Recent searches

No recent searches

Search options

Only available when logged in.
hachyderm.io is one of the many independent Mastodon servers you can use to participate in the fediverse.
Hachyderm is a safe space, LGBTQIA+ and BLM, primarily comprised of tech industry professionals world wide. Note that many non-user account types have restrictions - please see our About page.

Administered by:

Server stats:

9.7K
active users

hachyderm.io: AboutStatusProfiles directoryPrivacy policy

Mastodon: AboutGet the appKeyboard shortcutsView source codev4.3.5

#apacheFlink

0 posts0 participants0 posts today
InfoQ<p>Atlassian introduced Lithium - an in-house <a href="https://techhub.social/tags/ETL" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ETL</span></a> platform designed to meet the requirements of dynamic data movement.</p><p>Lithium simplifies cloud migrations, scheduled backups, and in-flight data validations with ephemeral pipelines and tenant-level isolation - ensuring efficiency, scalability &amp; cost savings.</p><p>📢 InfoQ spoke with Niraj Mishra, Principal Engineer at Atlassian, about Lithium’s implementation and future.</p><p>🔗 Read more here: <a href="https://bit.ly/415RPYZ" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://</span><span class="">bit.ly/415RPYZ</span><span class="invisible"></span></a></p><p><a href="https://techhub.social/tags/DataPipelines" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>DataPipelines</span></a> <a href="https://techhub.social/tags/KafkaStreams" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>KafkaStreams</span></a> <a href="https://techhub.social/tags/ApacheKafka" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ApacheKafka</span></a> <a href="https://techhub.social/tags/ApacheFlink" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ApacheFlink</span></a> <a href="https://techhub.social/tags/SoftwareArchitecture" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>SoftwareArchitecture</span></a></p><p><a href="https://techhub.social/tags/InfoQ" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>InfoQ</span></a></p>
Igor De Souza<p>Apache Flink: Overkill for Simple, Stateless Stream Processing and ETL?</p><p><a href="https://mastodon.social/tags/apachekafka" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>apachekafka</span></a><br><a href="https://mastodon.social/tags/apacheflink" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>apacheflink</span></a></p><p><a href="https://www.kai-waehner.de/blog/2025/01/14/apache-flink-overkill-for-simple-stateless-stream-processing/" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://www.</span><span class="ellipsis">kai-waehner.de/blog/2025/01/14</span><span class="invisible">/apache-flink-overkill-for-simple-stateless-stream-processing/</span></a></p>
Pierre Zemb<p>Spent this morning digging into a <a href="https://fosstodon.org/tags/ApacheFlink" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ApacheFlink</span></a> job in production. I just love this technology, both in development and operation. Give it a try!</p><p><a href="https://flink.apache.org/" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://</span><span class="">flink.apache.org/</span><span class="invisible"></span></a></p>
rmoff 🏃🏻 🍺 🥓<p>🎁 An early Christmas present for y'all: a new blog in which I explore Flink CDC. Building data pipelines declaratively is pretty nice, but is it ready for prime-time? Let's find out!</p><p>📝 <a href="https://dcbl.link/flink-cdc2" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://</span><span class="">dcbl.link/flink-cdc2</span><span class="invisible"></span></a></p><p><a href="https://data-folks.masto.host/tags/dataEngineering" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>dataEngineering</span></a> <a href="https://data-folks.masto.host/tags/ApacheFlink" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ApacheFlink</span></a> <a href="https://data-folks.masto.host/tags/ETL" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ETL</span></a> <a href="https://data-folks.masto.host/tags/ELT" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ELT</span></a></p>
Tom Cooper<p>Felt good to be at the first meeting of the Apache Flink Community Health Initiative (CHI) hosted by David Radley. Starting to make a dent in the long list of Open PRs and JIRA issues in upstream Flink project. Come join us make <a href="https://data-folks.masto.host/tags/apacheFlink" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>apacheFlink</span></a> move even faster! More details from David here: <a href="https://www.linkedin.com/pulse/addressing-apache-flink-technical-debt-community-health-radley-vtg0e/" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://www.</span><span class="ellipsis">linkedin.com/pulse/addressing-</span><span class="invisible">apache-flink-technical-debt-community-health-radley-vtg0e/</span></a></p>
Danica Fine<p>This role will let me build on my recent work, dive into new tech, and support the next wave of <a href="https://data-folks.masto.host/tags/openSource" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>openSource</span></a> innovation. While I may be shifting gears, I’m looking forward to continued collaboration with the wonderful <a href="https://data-folks.masto.host/tags/apacheKafka" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>apacheKafka</span></a> 🦦 and <a href="https://data-folks.masto.host/tags/apacheFlink" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>apacheFlink</span></a> 🐿 communities.</p>
rmoff 🏃🏻 🍺 🥓<p>🎃The October issue of <a href="https://data-folks.masto.host/tags/CheckpointChronicle" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>CheckpointChronicle</span></a> is now out 🌟</p><p>It covers Ververica's Fluss, <a href="https://data-folks.masto.host/tags/ApacheFlink" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ApacheFlink</span></a> 2.0, Iggy.rs, Strimzi's support for <a href="https://data-folks.masto.host/tags/ApacheKafka" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ApacheKafka</span></a> 4.0, tons of OTF material from <span class="h-card" translate="no"><a href="https://discuss.systems/@vanlightly" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@<span>vanlightly</span></a></span>, Christian Hollinger's write up of ngrok's data platform, nice detail of how SmartNews use <a href="https://data-folks.masto.host/tags/ApacheIceberg" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ApacheIceberg</span></a> with Flink and <a href="https://data-folks.masto.host/tags/ApacheSpark" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ApacheSpark</span></a>, a good writeup from Sudhendu Pandey on <a href="https://data-folks.masto.host/tags/ApachePolaris" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ApachePolaris</span></a>, notes from Kir Titievsky on Kafka's Avro serialisers, and much more!</p><p><a href="https://dcbl.link/cc-oct242" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://</span><span class="">dcbl.link/cc-oct242</span><span class="invisible"></span></a></p>
A stranger in a familier land<p>It&#39;s lunch time at the datastream summit!<br />Leave the data, take the cannoli<br /><a href="https://hachyderm.io/tags/datastreaming" class="mention hashtag" rel="tag">#<span>datastreaming</span></a> <a href="https://hachyderm.io/tags/apacheflink" class="mention hashtag" rel="tag">#<span>apacheflink</span></a> <a href="https://hachyderm.io/tags/apachepulsar" class="mention hashtag" rel="tag">#<span>apachepulsar</span></a></p>
A stranger in a familier land<p>I&#39;m at the streaming data summit and Taylor Swift is the topic of the conversation.<br />What is Taylor Swift to us?<br />A traffic spike!<br /><a href="https://hachyderm.io/tags/apachepulsar" class="mention hashtag" rel="tag">#<span>apachepulsar</span></a> <a href="https://hachyderm.io/tags/apacheflink" class="mention hashtag" rel="tag">#<span>apacheflink</span></a></p>
A stranger in a familier land<p>It&#39;s the formal opening of @FlinkFoward!<br />If you&#39;re here, the opening talks are starting!! <a href="https://hachyderm.io/tags/apacheflink" class="mention hashtag" rel="tag">#<span>apacheflink</span></a> <a href="https://hachyderm.io/tags/datastreaming" class="mention hashtag" rel="tag">#<span>datastreaming</span></a> <a href="https://hachyderm.io/tags/realtime" class="mention hashtag" rel="tag">#<span>realtime</span></a>!</p>
A stranger in a familier land<p>I&#39;m a sucker for a nice plushy. And these two are from <a href="https://hachyderm.io/tags/current24" class="mention hashtag" rel="tag">#<span>current24</span></a> and reprisent my favourite raft powered distributed systems, <a href="https://hachyderm.io/tags/TiDB" class="mention hashtag" rel="tag">#<span>TiDB</span></a> and <a href="https://hachyderm.io/tags/Redpanda" class="mention hashtag" rel="tag">#<span>Redpanda</span></a>!<br />Both which work great with @ververicadata and <a href="https://hachyderm.io/tags/apacheflink" class="mention hashtag" rel="tag">#<span>apacheflink</span></a></p>
A stranger in a familier land<p>Part two of the journey to <a href="https://hachyderm.io/tags/current24" class="mention hashtag" rel="tag">#<span>current24</span></a>, getting off the plane...<br />I&#39;ll see most of you all tomorrow, though some will be at the meet up this evening.<br />Ping me to chat nonsense about <br /><a href="https://hachyderm.io/tags/apacheflink" class="mention hashtag" rel="tag">#<span>apacheflink</span></a>, <a href="https://hachyderm.io/tags/apachePaimon" class="mention hashtag" rel="tag">#<span>apachePaimon</span></a> and <a href="https://hachyderm.io/tags/apachekafka" class="mention hashtag" rel="tag">#<span>apachekafka</span></a></p>
Tibs<p>🗓️ Wednesday September 18, 2024 at 9am PDT | 12noon EDT | 6pm CEST<br />Come learn **<a href="https://hachyderm.io/tags/ApacheKafka" class="mention hashtag" rel="tag">#<span>ApacheKafka</span></a>** with <span class="h-card" translate="no"><a href="https://mastodon.cloud/@celeste" class="u-url mention">@<span>celeste</span></a></span> ! In this 2 hour workshop you’ll learn the basic components of Kafka and how to get started with data streaming using Python. We&#39;ll also give a brief introduction to transforming your data using **<a href="https://hachyderm.io/tags/ApacheFlink" class="mention hashtag" rel="tag">#<span>ApacheFlink</span></a>**.<br />Read more and register ➡️ <a href="https://aiven.io/workshop/movie-recommender-with-tensorflow-pgvector?utm_source=mastodon&amp;utm_medium=organic&amp;utm_campaign=workshop-movie-recommender" target="_blank" rel="nofollow noopener noreferrer" translate="no"><span class="invisible">https://</span><span class="ellipsis">aiven.io/workshop/movie-recomm</span><span class="invisible">ender-with-tensorflow-pgvector?utm_source=mastodon&amp;utm_medium=organic&amp;utm_campaign=workshop-movie-recommender</span></a></p>
Public
InfoQ

#CaseStudy - Discover how #Yelp reworked its data streaming architecture with #ApacheBeam & #ApacheFlink!

The company replaced a fragmented set of data pipelines for streaming transactional data into its analytical systems, like Amazon Redshift and in-house data lake, using Apache data streaming projects to create a unified and flexible solution.

Dive into the details: bit.ly/3WgkTL7

#InfoQ#SoftwareArchitecture#EventDrivenArchitecture
Public
simplyblock

Do you know SQL? Exactly!

Most databases and data processing tools support SQL for exactly that reason. And we see a strong movement for all of them to get closer to the standard, day by day.

In this weeks episode of the Cloud Commute podcast, our host @noctarius2k talks with @gunnarmorling from #Decodable about the benefits of #SQL, how #CDC (change data capture) works and why Decodable uses #ApacheFlink as the underlying technology for its #StreamProcessing offering.

youtu.be/qrWBboOPY5U

Public
rmoff 🏃🏻 🍺 🥓

✍️Blogged: Flink SQL—Misconfiguration, Misunderstanding, and Mishaps

🫖 Pull up a comfy chair, grab a mug of tea, and settle in to read about my adventures troubleshooting some gnarly #ApacheFlink problems ranging from the simple to the ridiculous…

🔗 dcbl.link/troubleshooting-flin

👉 Topics include:

🤔 What's Running Where? (Fun with Java Versions)
🤨 What's Running Where? (Fun with JAR dependencies)
😵 What's Running Where? (Not So Much Fun with Hive MetaStore)

#dataEngineering#openSource
ExploreLive feeds
About