DAG integrity - unit test your DAG before deploy
Prepare a test to ensure the pipeline is good enough to deploy…
Let's try: Airflow 2
Airflow 2 comes with lots of improvements. Why not spend some times to get know this for easier batch job development?…
Let's try: Docker-compose
Dockerfile and docker-compose are tools to create an image or a cluster of images by ourselves. It's like unleash our creativity on devops.…
Conditional formatting with custom formula in spreadsheet
We can use conditional formatting in the spreadsheet to highlight some cells stand out and hook the viewers…
File is too big? Make it chunks.
Dealing with large files may cause insufficient resource during an operation…
Happy new year 2022
Be healthy. Be wealthy. Be happy all this new year. (Free bullet journal)…
Move to Ghost
This has been written after I completely and officially migrated this blog from Wordpress to Ghost…
A cat in my Mac
Got a new small app for Mac. It can display cute icons and monitor the resource of the Mac.…