A fully automated data import pipeline

Stichting Donateursbelangen

  • Customer case
  • Data Engineering
  • Data projects
logo stichting Donateursbelangen
Marieke Schulte
Chair Digital Power Datahub
3 min
01 Mar 2023

Stichting Donateursbelangen aims to strengthen trust between donors and charities. They believe that that trust is based on collecting money honestly, openly, transparently and respectfully. At the same time effectively using the raised donation funds to make an impact. To further this goal, Stichting Donateursbelangen wants to share information about charities with donors through their own search engine.

We assisted by making information about the ANBI status of charities available to use in their search engine. ANBI stands for public benefit institution and an institution is only given ANBI status when it’s (almost) entirely committed to the public interest and adheres to certain conditions.

Stichting Donateursbelangen had already worked on a solution for retrieving a public dataset from the website of the Dutch Tax and Customs Administration on a weekly basis through by converting the data to a Google Sheet with the help of Google Apps Script.

Their request was threefold:

  • Solve some technical issues in the current implementation
  • Automate a weekly update of the ANBI table and document updates to records
  • Add more data sources and data to the ANBI overview

Our approach

Initially we started working on the original request. We solved the technical issues in the current implementation. However, we ran into some questions regarding the choice for Google Apps Script for the implementation. Google App Scripts is limited in its data import and transformation capabilities, making it a challenging tool for expanding the table with additional information and data sources.

In consultation with Stichting Donateursbelangen we proposed to use a different tool, keeping in mind their requirements that the tool needs to be free and easy to maintain. We decided that it would be more efficient to build a new implementation with a Python based tool. This is more suitable for the purposes of this case. The new implementation was built in Google Cloud Platform using serverless Python Cloud Functions in combination with Cloud Scheduler for the automatic weekly imports.

The result

Stichting Donateursbelangen now has a fully automated data import pipeline with insights into the latest ANBI status for charities. They can report this information to interested charity donors on their no-code website solution. The search functionality on the Dutch Tax and Customs Administration website is limited to the search terms charity name or place of residence. The search functionality on the Stichting Donateursbelangen makes it possible for donors to find ANBI non-profits based on charity name, place of residence, fiscal number and website URL. The implemented solution meets their requirements of being free and easy to maintain.

quote Jordan

The future

Stichting Donateursbelangen has expressed the desire to expand their database and search engine with additional information about charities in the future. Using a Python script through Google Cloud Functions and Cloud Scheduler makes this process easier and faster to implement.

We carried out this project through our foundation, the Digital Power Datahub.

Want to know more about this project?

Marieke, chair of the Digital Power Datahub will be happy to talk to you about what we can do for you and your organisation as a data partner.

Marieke Schulte

Chair Digital Power Datahub+31(0)6 10 93 54 60marieke.schulte@digital-power.com

Receive data insights, use cases and behind-the-scenes peeks once a month?

Sign up for our email list and stay 'up to data':

You might find this interesting too

fysioholland data

A well-organised data infrastructure

FysioHolland is an umbrella organisation for physiotherapists in the Netherlands. A central service team relieves therapists of additional work, so that they can mainly focus on providing the best care. In addition to organic growth, FysioHolland is connecting new practices to the organisation. Each of these has its own systems, work processes and treatment codes. This has made FysioHolland's data management large and complex.

Read more
Data Engineer at work

Your Data Engineering partner

Generate reliable and meaningful insights from a solid, secure and scalable infrastructure. Our team of 25+ Data Engineers is ready to implement, maintain and optimise your data products and infrastructure end-to-end.

Read more
Data Engineer at work

Data Engineer

Work on challenging technical assignments with various clients.

Read more
doctor with stethoscope

Target group research for new website

The organisation Doctors of the World offers medical assistance to people in a vulnerable position. They often do not know how to find their way in the Dutch healthcare system. Doctors of the World helps them with this. One of the channels to get informed about the work of Doctors of the World is the website, which will be redesigned.

Read more

Improved data quality thanks to a new data pipeline

At Royal HaskoningDHV, the number of requests from customers with Data Engineering issues continue to climb. The new department they have set up for this, is growing. So they asked us to temporarily offer their Data Engineering team more capacity. One of the issues we offered help with involved the Aa en Maas Water Authority.

Read more

5 reasons to use Infrastructure as Code (IaC)

Infrastructure as Code has proven itself as a reliable technique for setting up platforms in the cloud. However, it does require an additional investment of time from the developers involved. In which cases does the extra effort pay off? Find out in this article.

Read more

A scalable machine-learning platform for predicting billboard impressions

The Neuron provides a programmatic bidding platform to plan, buy and manage digital Out-Of-Home ads in real-time. They asked us to predict the number of expected impressions for digital advertising on billboards in a scalable and efficient way.

Read more

Why do I need Data Engineers when I have Data Scientists?

It is now clear to most companies: data-driven decisions by Data Science add concrete value to business operations. Whether your goal is to build better marketing campaigns, perform preventive maintenance on your machines or fight fraud more effectively, there are applications for Data Science in every industry.

Read more

Digital transformation and better internal collaboration thanks to insight into offline and online data.

Publisher Malmberg collects a lot of offline and online data. More and more educational institutions are using online licenses in addition to (or instead of) printed teaching materials. To properly make use of this, Malmberg uses monthly reports. The in-house data team compiles these as input for specific departments. Malmberg asked us to strengthen this team and make the internal processes around data more efficient.

Read more