Apache NiFi does a great job when it comes to data flow automation. It excels in many regards – ease of use, built-in processors of all kinds, straightforward debugging or data provenance, to name but a few. Despite of a fairly moderate learning curve, there surely are new concepts to grasp. It took Read more…
There are several great articles giving advice on how to handle multiple GitHub accounts. The one I liked in particular has a pretty self-explanatory title: Automatically use correct SSH key for remote Git repo I value the article for two main reasons: It helped me solve my problem with the authentication agent It Read more…
I’ve just begun with Apache Hadoop. Getting started isn’t as straightforward as one might wish. There is quite a bit of work to do after the initial installation (“brew install hadoop” in my case). Expect tweaks and workarounds. Fortunately, there is plenty of advice available, such as this excellent blog post. After having installed Read more…
Copying files in Gradle is very intuitive. It’s easy enough to filter out unwanted files using the exclude pattern. Example (see documentation): task copyTaskWithPatterns(type: Copy) { from ‘src/main/webapp’ into ‘build/explodedWar’ include ‘**/*.html’ include ‘**/*.jsp’ exclude { details -> details.file.name.endsWith(‘.html’) && details.file.text.contains(‘staging’) } } The problem occurs, when you only want Read more…
Gradle is smart enough to skip running tasks if there haven’t been any changes compared to the previous build. This post shows how to override the default optimisation to ensure the given task is executed every single time. Let’s create a sample project: mkdir hello-gradle && cd $_ && gradle Read more…
Quite frequently, I reach for a combo of find and cd. Here is how to do it using a single command. Let’s create a bunch of nested directories, just for the sake of the exercise: mkdir -p x/y/z Result: tree x x └── y └── z Suppose I want to locate the Read more…