I came across blocks from blocks, and it’s packed with great features and ideas. A JSX-based page builder for creating beautiful websites without writing code
Publishing rhythm
I like asmeurer’s project removestar. Tool to automatically replace ‘import *’ in Python files with explicit imports
Check out lolcommits and their project lolcommits. 📷 git -based selfies for software developers
I’m really excited about mask, an amazing project by jacobdeichert. It’s worth exploring! 🎭 A CLI task runner defined by a simple markdown file
Check out pyjanitor-devs and their project pandas_flavor. The easy way to write your own flavor of Pandas
I like tj’s project go-termd. Package termd provides terminal markdown rendering, with code block syntax highlighting support.
I recently discovered git-history by pomber, and it’s truly impressive. Quickly browse the history of a file from any git repository
Check out csurfer and their project pypette. Ridiculously simple flow controller for building complex pipelines
Check out requests by psf. It’s a well-crafted project with great potential. A simple, yet elegant, HTTP library.
Check out vscode-git-semantic-commit by nitayneeman. It’s a well-crafted project with great potential. 💬 A Visual Studio Code extension which enables to commit simply by the semantic message conventions
awesome-streamlit by MarcSkovMadsen is a game-changer in its space. Excited to see how it evolves. The purpose of this project is to share knowledge on how awesome Streamlit is and can be
I’m impressed by js13k-2019 from bencoder. xx142-b2.exe. An entry for js13kgames 2019
Just starred death-to-ie11 by gabLaroche. It’s an exciting project with a lot to offer. Countdown for IE11 end of support
I came across awesome-data-engineering from igorbarinov, and it’s packed with great features and ideas. A curated list of data engineering tools for software developers
I’m really excited about vscode-python, an amazing project by microsoft. It’s worth exploring! Python extension for Visual Studio Code
If you’re into interesting projects, don’t miss out on Recreation-of-Nature, created by Kashu7100. ALife simulation with Python: patterns, behavior, and cognition.
Quick Progress Bars in python using TQDM
tqdm is one of my favorite general purpose utility libraries in python. It allows me to see progress of multipart processes as they happen. I really like this for when I am developing something that takes some amount of time and I am unsure of performance. It allows me to be patient when the process is going well and will finish in sufficient time, and allows me to 💥 kill it and find a way to make it perform better if it will not finish in sufficient time. @waylonwalker Add a simple Progress bar! convenience TQDM also has a convenience function called trange that wraps the range function with a tqdm progress bar automatically. notebook support There is also notebook support. If you are bouncing between ipython and jupyter I recomend importing from the auto module. Autoreload in Ipython If you are using notebooks you should enable ipython autoreload 👆
I’m impressed by bake from kennethreitz. Bake — the strangely familiar workflow utility.
Check out terminal by microsoft. It’s a well-crafted project with great potential. The new Windows Terminal and the original Windows console host, all in the same place!
Clean up Your Data Science with Named Tuples
If you are a regular listener of TalkPython or PythonBytes you have hear Michael Kennedy talk about Named Tuples many times, but what are they and how do they fit into my data science workflow. Example # As you graduate your scripts into modules and libraries you might start to notice that you need to pass a lot of data around to all of the functions that you have created. For example if you are running some analysis utilizing,, and data. You may need to calculate total revenue, inventory on hand. You may need to pass these data sets into various models to drive production or pricing based on predicted volumes. Load data # Here we setup functions that can load data from the sales database. Assume that we also have similar functions to and. Create Metrics # Here we create our first function to calculate some metrics. There are likely many of these functions that repeat a similar pattern. They use similar data and have their own custom logic for calculations and joins. Furthermore these…
Background Tasks in Python for Data Science
This post is intended as an extension/update from background tasks in python. I started using the week that Kenneth Reitz released it. It takes away so much boilerplate from running background tasks that I use it in more places than I probably should. After taking a look at that post today, I wanted to put a better data science example in here to help folks get started. This post is intended as an extension/update from background tasks in python. I started using the week that Kenneth Reitz released it. It takes away so much boilerplate from running background tasks that I use it in more places than I probably should. After taking a look at that post today, I wanted to put a better data science example in here to help folks get started. I use it in more places than I probably should Before we get into it, I want to make a shout out to Kenneth Reitz for making this so easy. Kenneth is a python God for all that he has given to the community in so many ways, especially with his ideas in bu…
If you’re into interesting projects, don’t miss out on starship, created by starship. ☄🌌️ The minimal, blazing-fast, and infinitely customizable prompt for any shell!
alttch has done a fantastic job with rapidtables. Highly recommend taking a look. Super fast list of dicts to pre-formatted tables conversion library for Python 2/3
Autoreload in Ipython
I have used for several years now with great success and 🔥 rapid reloads. It allows me to move super fast when developing libraries and modules. They have made some great updates this year that allows class modules to be automatically be updated. What I like about autoreload # 🔥 Blazing Fast 💥 Keeps me in the comfort of my text editor 👏 Allows me to use Jupyter when I need 👟 Extremely Reliable One of the biggest benefits that I find is that it shortens the distance between my module/library code and test code inside of a terminal/notebook. Now I primarily use jupyter notebooks for the presentation aspect. I develop code from the comfort of my editor with all of the tools I have setup, and run the functions in a notebook to get the output. From there I might do some aggregations or plots, but the 🥩 meat of development is done outside of jupyter. Now I primarily use jupyter notebooks for the presentation aspect. Enabling Autoreload # 📐 config This is a short script that I use to setup ip…
If you’re into interesting projects, don’t miss out on psutil, created by giampaolo. Cross-platform lib for process and system monitoring in Python
If you’re into interesting projects, don’t miss out on promote-open-source-project, created by zenika-open-source. 📄 How to promote my open source project?
Check out watchtower by kislyuk. It’s a well-crafted project with great potential. Python CloudWatch Logging: Log Analytics and Application Intelligence
I recently discovered arrow by apache, and it’s truly impressive. Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics
Just starred shell-functools by sharkdp. It’s an exciting project with a lot to offer. Functional programming tools for the shell
Keyboard Driven VSCode
Throw that mouse Away its time to setup some keyboard shortcuts. These sortcuts were the baseline for switching from tmux/vim to vscode. Most folks posts I was able to find gave great tips on replacing vim, but very few have focused on the hackability of tmux. tmux allows me to rapidly fire up a workspace, create new windows and splits. Then When I switch tasks I can leave that workspace open and and jump right back in later exactly where I left off. There is nothing quite like it. The shortcuts listed here make the transition a bit better. The worst thing I found when using vscode at first was no way to switch between the terminal and editor without the mouse. This first set of keybindings solve that issue. The worst thing I found when using vscode at first was no way to switch between the terminal and editor without the mouse.!!! see-also I have an updated article in my tmux workflow How I navigate tmux in 2021 Alt+[hjkl] # navigation ⬅ jump to left split alt+h ⬇ jump to terminal fro…
Looking for inspiration? Jupyter-Atom-Dark-Theme by burglarbenson. A dark theme for Jupyter Lab
tarpas has done a fantastic job with pytest-testmon. Highly recommend taking a look. Selects tests affected by changed files. Executes the right tests first. Continuous test runner when used with pytest-watch.
If you’re into interesting projects, don’t miss out on vim-flog, created by rbong. A blazingly fast, stunningly beautiful, exceptionally powerful git branch viewer for Vim/Neovim.
I like mcfunley’s project pugsql. A HugSQL-inspired database library for Python
I like ggreer’s project the_silver_searcher. A code-searching tool similar to ack, but faster.
Realistic Git Workflow
My git workflow based on real life. Its not always clean and simple. sometimes things get messy The Clean Path # pull 👉 branch 👉 format 👉 work👉 add 👉 commit 👉 pull 👉 rebase 👉 push Pull # As complicated as that seems it is pretty straight forward. When you sit down to work the first thing you do is to pull down the teams latest working “develop” branch from git. Branch # Next create a new branch with a name that will remind you of what you are working on. For your own sanity choose something descriptive. It is easy to get too many similar branches going and forget which branch is which. Format # If you know which files in existance that you will be editing before you start work it is a good idea to format them in a commit early on to keep your working commits separate from formatting. This will make it easier for reviewers to distinguish from your changes and formatting fixes. If your team agrees to a consistent formatting logic, sticks to it and always remembers to run the linting/fixi…
Just starred kedro by kedro-org. It’s an exciting project with a lot to offer. Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.
Check out forestryio and their project forestry.io. Forestry.io website
Check out maildown by chris104957. It’s a well-crafted project with great potential. A super simple CLI for sending emails
Forestry.io
Testing out forestry.io Sorry Netlify CMS # I still ♥️ your product dont be forestry is simple I have been playing with the netlify cms for a while now, and it has been a decent experience, but I really struggle configuring it. Forestry is so simple to setup. My favorite part is that I can code up my gatsby.js site, storing all editable text in markdown, and come back later and add the CMS based on existing documents. Configuration is Simple # Forestry.io has this amazing feature to create create based on existing document 🤯. This is great because it sets up the config for me without error. And If I really want to come back later to customize it more I have that option, too. Multi-File Gallery # I have a use case for a photography site where the owner wants to be able to show off sample photos of each type of work she does. I got it working in the netlify cms, although it was not very user friendly. Everything was nested in an accordian 😢. Next I looked into forestry.io. I pointed fore…
Just starred eslint-config-wesbos by wesbos. It’s an exciting project with a lot to offer. No-Sweat™ Eslint and Prettier Setup - with or without VS Code
Check out ydataai and their project ydata-profiling. 1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.
I came across ydata-profiling from Data-Centric-AI-Community, and it’s packed with great features and ideas. 1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.
mdbartos has done a fantastic job with tabview. Highly recommend taking a look. Python curses command line CSV viewer
TabViewer has done a fantastic job with tabview. Highly recommend taking a look. Python curses command line CSV and tabular data viewer
I came across voidrice from LukeSmithxyz, and it’s packed with great features and ideas. My dotfiles (deployed by LARBS)
I like FormidableLabs’s project webpack-dashboard. A CLI dashboard for webpack dev server
Rewrite History with Git
rebase git commit –amend Unstage # rage unstage to wipte out history of staged commit Undo file # rage quit git reset HEAD~n removes modifications keeps hitsory of changes and undoes them git checkout HEAD~n – keeps modifications removes history –SOFT –HARD –Mixed undo n commits back # locally before push after push update.gitignore # after push
It’s not all about winning
This is my story into data science. The Journey Begins # I am addicted to the process of learning and improving my skills nearly to a fault. The reason I say nearly is because my addiction is fueled with results. I crave the output of my work enhance the work of others. I jump with joy as I see users gain insights they could have never imagined before. My mouth starts watering as I see their boring repetitive data mining activites be completed in a matter of seconds, opening up their mind to focus on their expertise. The day I stop learning will be the day that I start looking for another career path. It’s not all about winning. ~Mom This happened to me in 2014. I have a mechanical engineering degree and had a really good position at the time. I owned full engineering control of a small subset of engine components. The problem was that Everything is so proprietary and hardly documented the process of learning did not click with me. I felt like I had learned a lot about the product earl…
Looking for inspiration? fzf-preview.vim by yuki-yano. The plugin that powerfully integrates fzf and (Neo)vim. It is also possible to integrate with coc.nvim.