Webinar Thumbnail - Creating Data Pipelines with Kafka and CloverDX

Webinar On-Demand: Creating Data Pipelines with Kafka and CloverDX

Kafka enables you to stream data in large quantities, but doesn't provide any real data-wrangling capabilities. CloverDX can help you work with data in Kafka and create comprehensive and auditable data pipelines.

Watch now
More Guides

Guides & White Papers

Data Integration Software

The Buyers' Guide to

Architecting Systems For Effective Control Of Bad Data

Your Guide to Enterprise Data Architecture

Designing Data Applications The Right Way

Data Migration for Humans

What makes a data migration successful?

Data Modeling and Data Integration

The Guide to Data Migration Projects

Data Migration for Humans

Conquering Challenges Of Data Anonymization

The Guide to AnaCredit

10 Things You Need to Know about AnaCredit

Looking for data integration software but not sure where to start?

Start with our Buyers' Guide.

This guide walks you through everything you should be considering when choosing the right software for your business - from how to identify your organization's needs and capabilities to planning for the future and tips to get the most out of a demo.

Read now and discover what you need to be asking potential vendors.

 

Bad data is unavoidable. But you can (and should) design your data processes to manage that bad data effectively.

Read the white paper to discover:

  • Best practices for automated error handling
  • How to involve business users in error management
  • How reporting can help auditing and process improvement

 

Is a data warehouse or a data lake the best option for your business?

Or is your best choice for enterprise data architecture something different?

This white paper looks at what each option involves, and the advantages and disadvantages of data warehouses, data lakes, data vaults, data hubs, data marts and more. 

Does your business handle data with an Excel file full of formulas and macros, being exchanged over email between people who don't really understand how it works?

If this approach is becoming unsustainable and error-prone, read this white paper to learn a better way.

Download and discover:

  • The importance of building in a separate data integration layer
  • How to separate the business logic from the data itself
  • How a data integration layer can speed up development, improve access to data and future-proof processes.

If you're facing the prospect of a data migration, this e-book will help you understand how to prepare and plan for a successful project. 

Download the e-book now and discover:

  • The danger of thinking a data migration is 'just an IT project'
  • How to minimize complexity
  • The importance of building in repeatability from the start

Data models provide a graphical, intuitive way for both business and technical stakeholders to visualize complex data structures and relationships.

But data models have historically required development effort to turn them into actionable code. 

The CloverDX approach can help automate this process.

Bringing data models and data integration together can improve collaboration between business and IT, speed up time to production and turn data models into ETL jobs at the click of a button.

Download the Guide to Data Migration Projects and discover the 13 stages involved in a migration, and the best practices to make each one a success.

The guide will show you:

  • How to scope your project properly
  • Why data discovery should be done before your budget
  • How to plan and work with understandable milestones
  • The importance of building an iterative data migration process

Getting high-quality test data can be a real challenge when it comes to testing. 

Synthetic data can never represent the same use case coverage and quality as real production data. But using production data can risk violating security or privacy policies. 

This white paper outlines how you can anonymize production data effectively to get the best possible data for testing.

10 Things You Need To Know About AnaCredit

AnaCredit (The Analytical Credit and Credit Risk Dataset), is a project from the European Central Bank (ECB) to create a shared database containing information on bank loans to companies. Credit institutions across the Eurozone will be required to report specific, standardized data on loans and other credits.

This e-book answers 10 key questions about AnaCredit and explains how to prepare for its data demands.

Video Webinars

Creating Data Pipelines with Kafka and CloverDX

19.58

Removing Danger From Data

24.14

Moving 'Something Simple' To The Cloud - What It Really Takes

35.11

Publish Data and Transformations over API

16.00

Data Quality - Building Data Pipelines with Bad Data in Mind

31.30

Data Anonymization For Better Software Testing

33.25

Modern Management of Data Pipelines Made Easier

38.10

Turning Data Models into ETL Jobs at the Click of a Button

30:15

Automated Data Architecture Development

15:30

Choosing The Right Data Architecture For Your Business

35:07

Analyzing the Analytics Function

15:35

Mind your D's and Q's: Ensuring Data Quality in Your Projects

29:42

Surviving a Data Migration

31:08

From Ad-Hoc to Automatic

26:36
Creating Data Pipelines with Kafka and CloverDX

Kafka enables you to stream data in large quantities, but doesn't provide any real data-wrangling capabilities. CloverDX can help you work with data in Kafka and create comprehensive and auditable data pipelines. 

Watch the webinar where we'll show you how to create modules in CloverDX that can:

  • Write to or read from topics in Kafka
  • Dynamically enrich incoming data
  • Process Kafka data streams and push to appropriate targets (APIs, data warehouses and so on)
Removing Danger From Data

Watch the webinar for a bird's eye view of the potential dangers data represents to organizations.

GDPR, CCPA, HIPAA and many other regulations and policies force us to take data, its lifecycle and the ways we treat it more seriously than ever before.

In this webinar we'll take a look at the dangers data can present, and show you how you can still get value from your data, without putting your organization at risk.

Moving 'Something Simple' To The Cloud - What It Really Takes

In this webinar we'll discuss what moving 'something simple' to the cloud really involves.

We'll examine the difference between deploying on-premise, the "VM way" and the fully-cloud way. 

And we'll show you a behind-the-scenes look at a real-life case, where a requirement from several business units triggered a hasty implementation at first, then raised some fundamental questions, and eventually lead to a cascade of decisions and an AWS cloud solution.

Publish Data and Transformations over API

In this webinar we'll look at the rise of APIs in modern data pipelines, and show you how you can use CloverDX to integrate applications' data with your ETL processes. 

Join us and learn:

  • The various options for API integrations, and what you should consider when building them
  • How to effectively pass data between systems
  • How CloverDX can help you:
    • Quickly design data processes and publish as REST APIs
    • Collect data from applications
    • Provide data transformations as a service
Data Quality - Building Data Pipelines with Bad Data in Mind

Bad data is so common that it would be seemingly insane to design your data processes and application to count on data being flawless.

Yet, many of us do.

In this webinar we’ll show you some best practices and techniques for assessing and ensuring data quality.

Watch now October 3rd to learn:

  • Where data quality problems could creep into your processes
  • How (and why) to design with bad data in mind at every step of your process
  • Tips for an effective error handling process
Data Anonymization For Better Software Testing
Watch now and discover how you can generate data that's as lifelike and close to production data as possible, without breaking privacy or compliance regulations.
 
Watch and discover:
 
  • What data anonymization really is
  • How it’s different to generated synthesized data
  • When you should use each version
Modern Management of Data Pipelines Made Easier

From data discovery, classification and cataloging to governance, anonymization and better management of data over its lifetime, register now to learn:

  • How to make data discovery and classification easier and faster at scale with smart algorithms
  • Best practices for standardization of data structures and semantics across organizations
  • What’s driving the paradigm shift from development to declaration of data pipelines
  • How to meet regulatory and audit requirements more easily with better transparency of data processes
Turning Data Models into ETL Jobs at the Click of a Button

Discover how to make your data models directly usable in IT operations.

Bridge the worlds of business and IT by generating actionable code directly from your data models. We'll show you how this approach can:

  • Improve transparency of your data processes - ideal for making compliance simpler
  • Reduce duplication of effort and complex processes involving many teams
  • Accelerate time to production with drastically reduced development cycles
Automated Data Architecture Development

This webinar examines 3 case studies where data integration tools have been just as valuable in developing a data architecture as they are in operating that architecture. 

  • A financial institution that dramatically reduced time to production
  • A company that automated regular updates to an analytics warehouse (and stopped using Excel)
  • An example of anonymizing real data to use in testing, overcoming strict privacy and security issues. 
Choosing The Right Data Architecture For Your Business

How do you choose the right data architecture for your needs?

Watch this webinar and discover:

  • The advantages of replicating operational data into various 'stores'
  • What some of those options involve, including overviews of data warehouses, lakes, hubs, vaults and more
  • Best practices for building those architectures
Analyzing the Analytics Function

This webinar looks at how a data integration platform can enable analysts to spend more time analyzing, and less time on the mundane work such as validating and cleansing data and delivering results.

  • Improve trust in results by protecting analysis from changes in data structure, location or quality
  • Create repeatable analysis workflows easily
  • Automate reading, writing, validation and logging
Mind your D's and Q's: Ensuring Data Quality in Your Projects

This webinar explores some techniques for ensuring data quality in your systems and looks at how you can use CloverDX to improve the quality of your data.

  • See how to detect issues early and prevent them from entering your systems
  • Create actionable reports to allow data quality issues to be understood and resolved
  • See how built-in validation tools in CloverDX can help identify and fix errors
Surviving a Data Migration

Who should be involved when migrating data between enterprise applications? What does moving data actually involve? How should you navigate the delicate dynamic between IT and business folks?

Watch the webinar and learn how we managed our own data migration, and the things we learned during the process.

From Ad-Hoc to Automatic

Watch this webinar and see how you can use CloverDX to simplify and automate data integration processes.

We also look at real-life examples of how people use CloverDX for reporting, data migration, data warehousing and analytics.