Skip to content

hantswilliams/general-dev-tools

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

53 Commits
 
 
 
 

Repository files navigation

General Dev Tools

A curated collection of development tools, libraries, services, and learning resources I use, like, or want to explore.

Quick Index by Team


Ongoing Reading — Medium Lists

Curated reading lists I maintain on Medium:

Podcasts

Regular rotation — a mix of AI, security, and Python:

Podcast Cadence Length Focus
The AI Daily Brief Daily ~15 min AI news
NVIDIA AI Podcast Weekly ~30 min AI applications
Cybersecurity Headlines Daily ~5 min Security news
Python Bytes Weekly ~30 min Python ecosystem
Darknet Diaries Monthly 1–2 hr Hacking / attack stories

1. Data Platform

Databases

Data Storage

  • Decentralized cloud storage
    • Storj — interesting for future encrypted messaging use cases
  • Data reading/writing (GCP, Azure, AWS)

Ingestion (ETL/ELT)

  • Flatfile — data onboarding platform
  • Fivetran — cloud data integration
  • Matillion — cloud data integration
  • Apache Gobblin — open-source distributed data integration
  • Singer — open-source standard for data movement scripts
  • Meltano — open-source ELT for DataOps
  • Airbyte — open-source data integration
  • Stitch — simple, extensible cloud ETL (Talend)
  • Hevo — no-code data pipeline
  • Apache Hop — open-source data integration
  • Meroxa — real-time data ingestion
  • Portable — cloud-hosted ELT
  • Others: Talend, StreamSets, Alooma (Google), Xplenty, Striim, Panoply, Stambia, HVR

Transformations

  • dbt — transformations
  • Apache Beam

Data Lineage

  • Pachyderm

Data Management

Catalogs & Lineage

Data Stack Reference


2. Analytics & Reporting

Visualization

Notebooks

Statistics & Data Manipulation

Geospatial & Enrichment


3. Integrations & APIs

APIs

Webscraping

Automation

Deployment Helpers

  • ngrok — quick localhost tunneling

Diagrams


4. Machine Learning

Core Frameworks

Cheat Sheets

Labeling

Bias

Drift / Monitoring

Scary Use Cases

Explainable

Forecasting

Features

NLP

Computer Vision

Recommendation

Session-Based Recommendations

Pre-Made ML / AI

AutoML

Awesome Lists & Notebooks

Datasets for Testing


5. Infrastructure & DevOps

IaC

CaaS (Cloud-as-a-Service)

Kubernetes

AWS Specific / Labs

Monitoring

Testing

Free Cloud Resources


6. Security

Cloud Checks

  • Scout Suite

Identity Management

Secrets Management

Multi-Cloud Account Switching

Pen Testing


7. Application Development

SaaS Starter Kits

Next.js

Codebase Generators

  • Divjoy — pick backend / frontend / deployment

Paid

Free

My evaluation notes (Free options)

  • Nextacular
    • Billing: Stripe
    • Documentation: limited / WIP — docs
    • Deployment: Vercel (auto SSL)
    • Databases: relational only (SQL / PostgreSQL / Aurora)
    • Pros: multi-domain; relational DB; teams + workspaces; Stripe; Tailwind; email handling
  • SaaS Starter Kit
    • Billing: Stripe
    • Documentation: good / mostly fleshed out — docs
    • Deployment: on your own
    • Databases: relational (Postgres) + non-relational (MongoDB)
    • Pros: ML example built in; onboarding; Docker; Stripe; AWS APIs

Low Code / No Code

Frontend Multi-Deployment

Frontend Styles

Authorization

Documentation Tools

Search Tools

Misc Utilities

Open Source Alternatives


8. Training & General Ed

Resources

Architecture & System Design

ML Learning

SQL Training

Python Training

Statistics Training

About

general development tools that i use, like, or want to explore

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors