I’m no programmer, it's why I am not able to easily write custom components for Keboola. I remember when the first version of Generic Extractor was released in 2016. I was part of the Professional Services team back then and that event has brought tons of benefits to my work, as I’ve been able to deliver components for getting data from various sources without need of external help. Of course, custom components have their merits, like better UI or possibility to tune up the performance, and are able to get data from the APIs that Generic is not able to handle.
But Generic Extractor is still a great component to get data from the most of the REST APIs, to create data feed super fast and can be also transformed into the regular component later on - plenty of our components are based on Generic Extractor, like Zendesk, LinkedIn or Github.
When I needed to send data to some APIs, everything became much more complicated and I had to ask a more skilled programmer to create a component. With the introduction of Generic Writer (built by David Esner, our consultant and creator of many Keboola Connection components), I am now able to load data by myself. Just like the Extractor, Generic Writer configuration is defined in JSON and you only need to add an Input Table with the request (all general methods are supported, like GET, PUT or DELETE).
Since its beta release a couple of weeks/months ago, I’ve created plenty of configurations which help me solve many use cases. I’d like to share one with you to show you how the new Writer works - creating an Item in Webflow Collection. Webflow is a tool we’re using to build our Website. Collection might be used as a page category or group. Item is a page.
Not that long ago, we’ve started a series of courses called Keboola Academy, where you can learn using Keboola Connection in a power user way and when you’re successful, you’ll receive a badge which is accessible on our website on your personal page as a proof. This is how your page looks like when you finish all of the tracks (of course I’m just a pretender and I have never finished the tracks, but looks good anyway…).
This example use case for the Writer is to create a page (like the one in the example) for a person which finished the course. Let's take a look at the API call which creates such page first:
Nothing unordinary - method, URI, headers, single url parameter, and body. You can find the API call description in Webflow API docs.
And this is the configuration of the Writer which does the same (except the values in the body): See the configuration.
To have a complete picture before describing the parts of the config, here’s the table we’re using as the Input:
Let's take a look at some interesting parts of the configuration:
Overall, the configuration is not that difficult. And from my experience, once you create your first working configuration, the other will be much easier (I recommend just to copy the previous one and adjust it to your new needs :) ).