IWSR, the global leader in beverage alcohol data and insights, produces data reports that the market relies on. By adopting CloverDX, IWSR revolutionized their data ingestion processes, enabling them to reduce repetitive manual data entry, handle diverse data formats, and free up domain-expert researchers to focus on higher value tasks.
Read on to discover how CloverDX helped IWSR streamlined these processes...
IWSR’s global database, spanning 160 markets, underpins strategic decision-making for some of the world’s largest beverage brands. Compiling data for this annual report was a painstaking job that had to be undertaken by the company’s researchers. Thousands of files in varied and inconsistent formats had to be manually matched and entered into IWSR’s systems – a process which involved time-consuming tasks such as cross-checking and copying data across multiple screens, reformatting Excel files, and remembering previous matching decisions.
“Our customers rely on this data, so it’s key that we get this process spot on,” explains Chief Data Officer Andy Noble.
IWSR Researcher, Shirley Zhu remembers how painstaking the process used to be: “We used to have to check through the data, and then copy the data to another Excel file, and then manually key this data into our internal tool. And I’d have to do this for every file.”
Similarly, the IWSR Product Manager, Jamie Connolly agrees, “It was a very, very manual process up until this point. Every number that we publish, a researcher had to type into a spreadsheet.”
As data volumes were increasing, and the company was looking to grow, IWSR recognized the need to transition from the labor-intensive process to a scalable, automated solution to ingest the thousands of Excel files and free up valuable time.
IWSR turned to CloverDX, and specifically CloverDX’s Business Tools features, to automate and streamline how data was transformed, mapped, and ingested into their systems.
Wrangler, part of CloverDX Business Tools, serves as the first line of defense in tackling incoming, unstandardized data. With Wrangler’s intuitive drag-and-drop interface, domain experts could categorize and standardize data columns, mapping them into a consistent structure.
- David Green, Chief Technology Officer at IWSR
Once the files are standardized, domain experts use CloverDX Data Manager to take incoming data and match it to IWSR’s standardized taxonomy for market names, brandlines, and product categories.
David Green explains that “The really valuable bit that the researchers were doing was that they weren’t just copying blindly, they were using their domain knowledge to know which rows went with which rows. It was that matching process that was key.”
Using Data Manager eliminated the need to manually reconcile fields, and meant users didn’t need to remember previous matching decisions. IWSR has created a ‘seen it before’ repository, where decisions are logged for use in future research cycles, reducing duplication of effort and increasing consistency. As Product Manager Jamie Connolly explains: “When we see that same file from that same source again, we can automatically skip the matching step. Everything is centralized, repeatable, and consistent.”
IWSR’s market-leading position comes from the expertise of their researchers – so while much of the manual, repetitive process was automated, it was important that the researchers still had oversight over final validation and approval. This approach balances automation with human expertise, safeguarding trust and accuracy.
Head of Product and Programs, Sam Landers points out how much easier the process is now for the researchers: “Researchers receive the prepared data in collector tools, ready to review. This is a marked improvement over hours spent matching, reformatting, and typing.”
Since implementing CloverDX, IWSR has redefined its data processes, achieving measurable and far-reaching outcomes:
“We believe we’ve saved an average of 66 hours per researcher during this research cycle” says CDO Andy Noble.
Saving what equates to over 8 working days for every researcher has freed up time to be spent on more valuable tasks that make use of their expertise, such as industry interviews and analysis.
CTO, David Green explains that it wasn’t only about saving time, but about being able to make the most of the researchers’ knowledge: “We were trying to free up as much of the expert time as possible – getting other people to do more of the heavy lifting and leave the real domain expertise to the domain experts. We weren’t trying to reduce headcount, we wanted them to be spending their time doing other things to add more value to the business.”
- Sam Landers, Head of Product and Programs at IWSR
The feedback from the researchers themselves has also been positive. Researcher, Jose Luis Hermoso says “It was much easier for me to have everything in one place and to see the progress. It’s really nice to be able to trust such a tool in this very busy period for us.”
Fellow IWSR Researcher, Shirley Zhu also appreciates the time saved:
IWSR now processes thousands of files through a consistent, repeatable data ingestion pipeline that handles varied data formats. Scaling operations is now possible without a proportional increase in resource.
“CloverDX has given us a way of tackling the inherent complexity of ingesting Excel files,” comments CTO, David Green.
By eliminating manual data entry, centralizing logic, and automating repeatable decisions, the risk of errors has been significantly reduced.
“It’s improved efficiency with no change in the quality of the output,” says CTO, David Green.
And with researchers having final oversight and quality control over the final outputs, Sam Landers explains that trust has been maintained. “It was a big change for our researchers, but we worked hard to train them on the process, and we’ve built their trust in the process and the QC steps.”
And as Product Manager, Jamie Connolly adds, “The real highlight is researchers no longer need to second-guess decisions or double-check data inputs. Consistency and accuracy are baked into the system.”
CloverDX – and the CloverDX Business Tools specifically – has been a valuable part of IWSR’s digital transformation, helping eliminate wasted time, automate data ingestion, and maintain integrity.
CDO Andy Noble remarks that “The more we can use tooling like CloverDX to free up time to do things that humans are better at doing, the better we get, the faster we get, the easier it is to scale. It’s easy to think we automate to save costs, but we don’t, we automate to save time.”
These significant time savings are making it easier for IWSR to grow their business.
- David Green, Chief Technology Officer at IWSR
IWSR has plans to expand the CloverDX integration into new products and verticals, building on the robust data foundation to scale future growth while providing reliable, critical market insights to their customers.
As David Green says: “The goal of this project was to help us scale, so we could handle more markets and more data without having to just hire more people. Now we’ve made the process so much more efficient we can keep growing, and grow the business without necessarily having to scale the team itself.”
Having a strong, repeatable data ingestion pipeline that’s scalable across the business is also opening up completely new business opportunities, as Jamie Connolly explains: “By having this generic process, we start to be able to link up completely different datasets that we’ve never linked up before, or that would take weeks and a huge amount of manual effort to do.”
Sam Landers adds: “It has the potential to unlock other data product opportunities, by giving our custom analytics teams much easier access to data to draw out insights for clients."
Building automated data ingestion pipelines, and freeing up the time of domain experts, has given IWSR a platform to continue to scale and grow. As David Green says: “We’re just scratching the surface. Scaling across new project verticals is forthcoming, and everything we’ve built is flexible for future growth.”
- Sam Landers, Head of Product & Programs at IWSR
As one team defined the rules—how the data should look, how categories should align, and what validations mattered—the technical team ensured those rules were built into scalable pipelines that handled data in the right sequence. Together, they created a process where expertise and CloverDX automations worked hand in hand.
IWSR is the world’s leading provider of data and insights for the beverage alcohol industry.
Trusted by global brands, they collect and analyze data from over 160 markets to provide strategic intelligence, benchmarking, and trend forecasting.