A fully automated data import pipeline
Stichting Donateursbelangen
- Customer case
- Data Engineering
- Data projects
Stichting Donateursbelangen aims to strengthen trust between donors and charities. They believe that that trust is based on collecting money honestly, openly, transparently and respectfully. At the same time effectively using the raised donation funds to make an impact. To further this goal, Stichting Donateursbelangen wants to share information about charities with donors through their own search engine.
We assisted by making information about the ANBI status of charities available to use in their search engine. ANBI stands for public benefit institution and an institution is only given ANBI status when it’s (almost) entirely committed to the public interest and adheres to certain conditions.
Stichting Donateursbelangen had already worked on a solution for retrieving a public dataset from the website of the Dutch Tax and Customs Administration on a weekly basis through by converting the data to a Google Sheet with the help of Google Apps Script.
Their request was threefold:
- Solve some technical issues in the current implementation
- Automate a weekly update of the ANBI table and document updates to records
- Add more data sources and data to the ANBI overview
Our approach
Initially we started working on the original request. We solved the technical issues in the current implementation. However, we ran into some questions regarding the choice for Google Apps Script for the implementation. Google App Scripts is limited in its data import and transformation capabilities, making it a challenging tool for expanding the table with additional information and data sources.
In consultation with Stichting Donateursbelangen we proposed to use a different tool, keeping in mind their requirements that the tool needs to be free and easy to maintain. We decided that it would be more efficient to build a new implementation with a Python based tool. This is more suitable for the purposes of this case. The new implementation was built in Google Cloud Platform using serverless Python Cloud Functions in combination with Cloud Scheduler for the automatic weekly imports.
The result
Stichting Donateursbelangen now has a fully automated data import pipeline with insights into the latest ANBI status for charities. They can report this information to interested charity donors on their no-code website solution. The search functionality on the Dutch Tax and Customs Administration website is limited to the search terms charity name or place of residence. The search functionality on the Stichting Donateursbelangen makes it possible for donors to find ANBI non-profits based on charity name, place of residence, fiscal number and website URL. The implemented solution meets their requirements of being free and easy to maintain.
The future
Stichting Donateursbelangen has expressed the desire to expand their database and search engine with additional information about charities in the future. Using a Python script through Google Cloud Functions and Cloud Scheduler makes this process easier and faster to implement.
We carried out this project through our foundation, the Digital Power Datahub.
Want to know more about this project?
Marieke, chair of the Digital Power Datahub will be happy to talk to you about what we can do for you and your organisation as a data partner.
Chair Digital Power Datahub+31(0)6 10 93 54 60marieke.schulte@digital-power.com
Receive data insights, use cases and behind-the-scenes peeks once a month?
Sign up for our email list and stay 'up to data':
You might find this interesting too
A well-organised data infrastructure
FysioHolland is an umbrella organisation for physiotherapists in the Netherlands. A central service team relieves therapists of additional work, so that they can mainly focus on providing the best care. In addition to organic growth, FysioHolland is connecting new practices to the organisation. Each of these has its own systems, work processes and treatment codes. This has made FysioHolland's data management large and complex.
Your Data Engineering partner
Generate reliable and meaningful insights from a solid, secure and scalable infrastructure. Our team of 25+ Data Engineers is ready to implement, maintain and optimise your data products and infrastructure end-to-end.
Target group research for new website
The organisation Doctors of the World offers medical assistance to people in a vulnerable position. They often do not know how to find their way in the Dutch healthcare system. Doctors of the World helps them with this. One of the channels to get informed about the work of Doctors of the World is the website, which will be redesigned.
Improved data quality thanks to a new data pipeline
At Royal HaskoningDHV, the number of requests from customers with Data Engineering issues continue to climb. The new department they have set up for this, is growing. So they asked us to temporarily offer their Data Engineering team more capacity. One of the issues we offered help with involved the Aa en Maas Water Authority.
A scalable machine-learning platform for predicting billboard impressions
The Neuron provides a programmatic bidding platform to plan, buy and manage digital Out-Of-Home ads in real-time. They asked us to predict the number of expected impressions for digital advertising on billboards in a scalable and efficient way.