Data

A/B Testing For Practical Significance

When doing statistical hypothesis testing, the math behind it gives us the toolset to determine the statistical significance of our observations. But if we’re doing a two-sample test on a simple hypothesis, eg. $H_{0}:\mu_{1}=\mu_{2}$ vs. $H_{1}:\mu_{1}\ne\mu_{2}$ rejecting it won’t tell us anything about the magnitude of the difference. Usually aside from making sure that the difference in measurements you observed are statistically significant, you want your observed differences to be practically significant as well. That…

Continue reading

Data Hacks

How to Fetch Comments for any Medium Post

Medium is a treasure trove if you want to practice NLP or get data to train your models for other purposes. Luckily, it’s possible to fetch JSON data for any medium post together with its metadata about author, claps, tags, etc. Recently I wanted to try out the Google Natural Language API for sentiment analysis and run it on responses to Medium articles. Responses are what would be called comments elsewhere, but you’ll see that…

Continue reading

Hacks

gitroot – a Simple Command to Navigate to the Root of a Git Repo

When it comes development environments I’m old fashioned – I prefer using Vim and navigate the filesystem from the terminal. A thing that always annoyed me is returning to top level directory in a git repo from somewhere deeper within. It turns out that there’s a really simple solution – just make a bash alias gitroot as follows alias gitroot=’cd $(git rev-parse –show-toplevel)’ Put that line either in ~/.bashrc or if you use zsh in…

Continue reading

Hacks

A Simple Password Manager in a Dozen Lines of Bash

A while ago I wanted to create my own password manager, something very simple that would enable me to generate random passwords instead of using the same one all over the internet. I ended up using the code below for a few years now. The idea that I went with was to make two bash scripts: savepass.sh used to generate a random password, save it in an encrypted file and keep that file in a…

Continue reading

Podcast Notes

Atomic Habits – Notes from Indie Hackers podcast with James Clear

I’m a huge fan of IndieHackers.com, following both the newsletter and the podcast. I’ve heard about James Clear before, related to his 2018 book Atomic Habits, and the name kind of stuck. I haven’t looked much into his work, and haven’t yet read the book. To be honest, I just assumed it’s another business book that’s in fact an idea inflated to fit a 200 page book because you can’t sell a printed blog post.…

Continue reading