Skip to content

Latest commit

 

History

4 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 

Repository files navigation

My Links

Table of Contents

Tools by Category

General IT News

Linux News and Articles

Linux Message Boards and Forums

Asset Management

  • Asset Inventory and Job Tracking (IRMA) - Asset tracking and trouble ticketing system with barcode and LDAP/AD interface capabilities
  • Clusto - Inventory tracking and "cluster management" system
  • Collins - Infrastructure source of truth, created by Tumblr
  • Fusion Inventory - Mulit-lingual
  • Genesis - Hardware discovery, by Tumblr, can report to Collins
  • GestioIP - IP address management (IPAM), web based, supports discovery
  • GLPI - Also provides license management, software auditing, and ticketing
  • HostDB - New tool to help manage data center inventory
  • IP Plan - IPAM written in PHP
  • IT ITems DataBase (ITDB) - Includes purchase order management, floor plans, and ISO20000-like features
  • Network UPS Tools - Manage power devices from over 100 manufacturers using a single web interface
  • OCS Inventory NG (OCS-NG) - Automated inventory, deployment system, can sync with GLPI
  • openDCIM - Data center infrastructure management
  • phpIPAM - Written in perl. No, Ruby. No, Perl. Probably PHP
  • RackMonkey - No longer under development as of 2013
  • RackTables - Data center asset management, highly recommended
  • racktables-contribs - RackTables user-contributed plugins
  • Ralph - DCIM and CMDB, supports auto-discovery
  • rho - Scans for and gathers information about Linux and Unix servers
  • Snipe IT - Uses Bootstrap, web based, supports mobile
  • Tracmor - Web-based inventory and asset tracking system written in PHP 5 utilizing the Qcodo Framework

AWS Tools

  • awstools - Some handy AWS tools and scripts that use boto3 and troposphere
  • boto3 - Python library for interfacing with AWS, aka AWS SDK for Python
  • CASTER - Chrome extension that automatically re-logs into AWS via ADFS before credentials expire
  • CloudBerry Explorer - Windows client for accessing AWS S3 buckets -- freeware, closed source
  • Developer Tools - 3rd party tools for AWS - not screened or supported by Amazon
  • ec2dns - CLI tools to display public host names of instances and SSH into them via their tag
  • ElasticWolf - Client-side GUI for managing AWS, has versions for Windows/Mac/Linux/Firefox
  • haproxy-autoscale - Wrapper for haproxy that handles auto-scaling EC2 instances
  • JAWS Stack - Javascript + AWS stack, the entire backend is Lambda functions, server-free
  • kappa - CLI tool that makes it easier to deploy, update, and test Lambda functions
  • s3cmd - Backup to AWS via the command line
  • Sneaker - Store secrets on S3 using Amazon KMS
  • StarCluster - Toolkit for using AWS for high performance computing (HPC)
  • Tools for Amazon Web Services - Amazon's portal for their official tools
  • troposphere - Python library to create CloudFormation descriptions

Backups

  • Amanda - The classic
  • Attimatic - Wrapper for attic to make it easier and more reliable
  • Attic - Written in Python
  • Backupninja - Centralize way to configure and schedule many different backup utilities
  • BackUp and Restore Program (BURP) - Reduces network traffic and the amount of space required by using librsync
  • BackupPC - Dedupe and a web GUI for restores
  • Backup - RubyGem for backup and restore, supports tons of platforms and notifiers (RDBMS, S3, Dropbox, rsync, Hipchat, Zabbix)
  • Bacula - Open source backup tool, lots of downloads so I guess it's good I don't know
  • Back in Time - Similar to TimeMachine, simple GUI backup program
  • bup - Uses the git packfile format, supports global dedupe, can use "par2" redundancy
  • Deja Dup - GUI for duplicity
  • Disk ARchive (DAR) - Better than tar, focuses on disks instead of tapes
  • Duplicati - Supports encryption and dedupe
  • Duplicity - Encrypted bandwidth-efficient backup using the rsync algorithm
  • Fpart - Packs file systems into "partitions" so you can do multi-threaded or multi-node rsyncs
  • FSArchiver - Save the contents of a file system to a compressed archive, if one of the checksums doesn't match the file is lost, not the whole backup
  • Grsync - GUI for rsync
  • lsyncd - Watches a local directory trees event monitor interface (inotify or fsevents) and kicks off an rsync when things change
  • Mondo Rescue - Disaster recovery, supports tapes, disks, network and CD/DVD as backup media, multiple filesystems, LVM, software and hardware RAID
  • Obnam - Snapshots, dedupe, encryption
  • rdiff-backup - Combines the best features of a mirror and an incremental backup in a bandwidth efficient manner
  • Redo Backup and Recovery - Simple bare metal backup and restore
  • Relax and Recover (REAR) - BMR, simple
  • rsnapshot - Uses rsync and hard links, can keep multiple full backups available while using very little disk space
  • SafeKeep - Superb project, uses LVM snapshots
  • SnapRAID - Backup program that also stores RAID parity information
  • UrBackup - Supports Windows, has a web interface
  • wal-e - Simple continuous archiving for Postgres
  • zpaq - Free incremental and journaling command-line archiver, supports Windows

Bootable USB Tools

Configuration Management and Orchestration

  • Ansible - CM and orchestration, also can do provisioning
  • Ansible Galaxy - Community site for finding, reusing, and sharing Ansible content
  • Archipel - Push notifications to virtualization orchestration using XMPP
  • Awesome Chef - A curated list of amazingly awesome Chef resources
  • Batou - Define and perform automated service deployments
  • Berkshelf - Like Bundler for Chef cookbooks, manages dependencies
  • Blueprint - Reverse engineer a server configuration
  • BOSH - Cloud orchestration, supports Docker containers too
  • Boxen - Focused on Mac / OS X
  • Capistrano - Run scripts/commands and push software using SSH, a RubyGem, uses a Rake DSL
  • Chef - Well known configuration management tool
  • chef-handlers - Log failures to IRC and send metrics to Graphite (including deploys)
  • chef-relevant-test - Runs Test Kitchen tests only on the parts of your code that changed (rather than the full suite)
  • ChefScripts - Quickly parse the Chef run log to get the resources updated recently, in chronological order
  • Chef Development Kit (ChefDK) - Includes Berkshelf, Test Kitchen, ChefSpec, Foodcritic, Knife, Chef Zero, Ohai, and more
  • Chef Supermarket (community) - Massive collection of cookbooks
  • Chef Supermarket (private) - Community cookbook repository for Chef, can be hosted internally
  • ElasticBox - Create your own catalog of applications and infrastructure components then build, deploy, and go
  • Fabric - Python library, uses SSH
  • grocery-delivery - Utility for managing cookbook uploads to distributed Chef backends, by Facebook
  • hiera-eyaml - Backend for Hiera that provides per-value encryption of sensitive data within Puppet yaml files
  • Juju - Ubuntu focused but works on RHEL / CentOS now
  • kitchen-puppet - Test Kitchen provisioner for Puppet
  • knife-backup - Knife plugin to help backup and restore a Chef server
  • knife-sharp - Adds features such as data bag/environment/role sync & backup
  • Knife Community Plugins - List of community written plugins for Knife
  • librarian-puppet - Bundler for Puppet, manages dependencies
  • mcollective - Orchestration, can be used independently of Puppet
  • motherbrain - Use knife to spin up one node? Nah, use this to create a whole environment
  • omnibus - Create full-stack installers for your project, Chef
  • Open Linux Management Infrastructure (OpenLMI) - Manage, monitor, and configure servers via API calls (instead of SSH), included in RHEL 7
  • Opscode - Chef on Github, tons of great tools
  • Opskeleton - Great for test environments
  • Puppet - Well known CM tool
  • puppet-lint - Check that your Puppet manifest conform to the style guide
  • puppet-profiler - Find out what's making your Puppet runs so slow
  • Puppet Dashboard - Web based dashboard for Puppet
  • Puppet Forge - Community repository of Puppet modules
  • puppet-module-skeleton - Skeleton modules for Puppet
  • r10k - General purpose toolset for deploying Puppet environments and modules
  • Really Awesome New Cisco config Differ (RANCID) - Designed to monitor network hardware
  • Rex - Agentless server orchestration, written in perl
  • Rudder - Automation and compliance, uses CFengine
  • Rundeck - Easy automation
  • Saltstack - Orchestration, server provisioning, and configuration management
  • ServerSpec - RSpec tests for your servers configured by Puppet, Chef or anything else
  • Slaughter - Centralized system-administration & configuration tool
  • Sovereign - Set of Ansible playbooks to deploy your own private cloud, very feature-rich
  • spiceweasel - Quickly automates the creation of whole Chef environments (batch loading)
  • ssl-vault - Chef cookbook to manage SSL keys, certificates & chains using chef-vault
  • tarball - Ruby-based resource provider to manage tarballs in Chef
  • Test Kitchen - Automated testing for configuration management tools (mostly Chef)
  • VirtKick - Simple panel for orchestrating VMs and containers
  • zero-user - Zero hassle Linux user management, requires Ansible

Containers

  • Bocker - Docker written in 100 lines of shell
  • boot2docker - Lightweight Linux distribution running Docker, packaged as an VM for OS X and Windows
  • cadvisor - Analyzes resource usage and performance characteristics of running containers
  • crane - Docker orchestration
  • Distribution - Docker Registry 2.0, supersedes docker-registry
  • Docker - Designed to applications in a container, but not a whole OS instance
  • dockerfiles - Great little collection of pre-made Docker files
  • DockerUI - Web interface for Docker
  • Docker Compose - Define and run multi-container apps with Docker, previously known as fig
  • Docker Hub - Official Docker images for many projects
  • Dokku - Docker powered mini-Heroku (PaaS) in around 100 lines of Bash
  • Dokku Alternative - Dokku fork, supports plugins
  • Ferry - Launch, run, and manage big data clusters without worry about infrastructure
  • Fleet - Treat your CoreOS cluster as if it shared a single init system
  • Flocker - Docker data management for stateful services such as DBs
  • Flynn - PaaS built on top of Docker, can run stateful services
  • geard - CLI tool for installing Docker images as containers onto a systemd-enabled Linux system
  • Hyper - Hypervisor-agnostic Docker engine
  • Kitematic - Mac app for managing Docker containers
  • libcontainer - Used by Docker 1.0+ so it doesn't have to use LXC/libvirt/systemd-nspawn
  • Linux Containers (LXC) - Runs an OS instance (sshd, cron, daemons, init, etc) within a container
  • Nomad - A distributed, highly available, data-center aware scheduler
  • Panamax - Containerized app creator with an open-source app marketplace hosted in GitHub
  • pipework - SDN for Linux Containers
  • Rancher - Provides a complete platform for operating Docker in production
  • Registrator - Service registry bridge for Docker, supports Consult, etcd
  • rkt (Rocket) - New container system by the CoreOS guys
  • Shipyard - Composable Docker management toolkit
  • ShutIt - Manage your build process in a way that is both structured and flexible
  • SmartDataCenter (SDC) - Containers and SmartOS, by Joyent
  • Swarm - Docker-native clustering system
  • Ventriloquist - Combines Vagrant and Docker to give developers the ability to configure portable and disposable dev environments
  • Weave - Virtual network that connects Docker containers deployed across multiple hosts
  • Zenoss Control Center - PaaS framework for deploying enterprise applications using Docker

Dashboards and Visualization

  • Awesome Dashboard - A collection of dashboards
  • Bigdesk - Live charts and statistics for Elasticsearch cluster
  • blockdiag - Generate simple block/sequence/activity/network diagrams from text files
  • Cachet - Create beautiful, responsive status pages. Written in PHP
  • Cacti - Web-based network monitoring and graphing tool designed as a front-end to RRDtool
  • collectd3 - Beautiful D3JS visualizations of system performance statistics
  • Dashing - Dashboard framework written in Ruby
  • Dashing Widgets - Massive collection of widgets for Dashing
  • draw.io - Free online flow chart maker / Visio alternative
  • Freeboard - Ridiculously simple dashboards for your devices
  • FreeMind - OSS mind mapping software, great for brainstorming
  • GoAccess - Real-time web log analyzer and interactive viewer that runs in a terminal and/or dashboard
  • Graphite-Sankey - Turns Graphite targets into a D3.js Sankey visualization
  • Inkscape - Open source vector image editor
  • Kibana - Visualization component of the ELK stack
  • ksar - Creates pretty graphs from sar output
  • LICEcap - Capture an area of your desktop (eg: a terminal) and save it to a GIF
  • linux-dash - A simple web dashboard to monitor your Linux server
  • logstalgia - Web site access log visualization tool, aka Apache Pong
  • Grafana - Modern dashboard for Graphite
  • Graphviz - Graph visualization and flow chart software
  • Gravit - Web-based vector image editor / design tool, source code is available on GitHub
  • maim - The most powerful and flexible Linux desktop screenshot tool
  • Nagdash - Dashboard / NOC screen for Nagios
  • NagVis - Visualization suite for Nagios
  • Nagiosgraph - Another visualization tool for Nagios data
  • Network Weathermap - Network visualization tool, create a "weather map" just like big ISPs use
  • php-weathermap-graphite - Allows Network Weathermap to source data from Graphite
  • PNP4Nagios - Nagios visualization tool
  • ScreenCloud - Take a screenshot and either upload it to their site to share, or save it locally
  • Seyren - Alerting dashboard for Graphite
  • Skitch - Feature-rich screenshot editing, sharing, and annotation tool -- closed source
  • TermRecord - Record and playback terminal sessions
  • Thruk - Web interface for Nagios, Icinga, Shinken and Naemon, can create SLA reports, has a mobile client
  • Uchiwa - Dashboard for Sensu
  • Varnish Dashboard - Realtime dashboard for Varnish cache servers
  • vnstati - Creates PNG images using vnStat data

Distributed Systems Tools

  • Aurora - Mesos scheduler for long running services and cron jobs, similar to Marathon
  • Bamboo - HAProxy auto configuration and auto service discovery for Marathon
  • Chronos - Distributed, fault tolerant cron scheduler that runs on top of Apache Mesos
  • Cisco Cloud Microservices Infrastructure - Complete suite of OSS tools
  • crypt - Store and retrieve encrypted configs from etcd or Consul
  • consul - Service discovery and configuration via DNS or HTTP, great for auto-scaling
  • Curator - ZooKeeper client wrapper and rich ZooKeeper framework, by Netflix
  • etcd - Distributed, consistent key-value store for shared configuration and service discovery
  • eureka - AWS Service registry for resilient mid-tier load balancing and failover, by Netflix
  • FileUtils - File utilities for distributed computing
  • git2consul - Mirror git repos to Consult K/V stores
  • Herd - A single-command bittorrent distribution system, based on Twitter's Murder
  • Hystrix - Library to stop cascading failures
  • jespen - Call Me Maybe: simulating network partitions in DBs
  • Kong - Microservice / API management layer
  • kubernetes - Open source orchestration system for Docker containers by Google
  • Marathon - Mesos scheduler for "always on" jobs (eg: web services)
  • marathon-consul - Take information provided by the Marathon event bus and forward it to Consul's KV tree
  • Mesos - Cluster manager and scheduler, similar to Google's Borg and Omega projects
  • mesos-consul - Automatically registers/deregisters services run as Mesos tasks
  • Mesosphere - Apache Mesos schedulers for almost anything
  • Myriad - YARN framework/scheduler for Mesos
  • nsq - Realtime distributed messaging platform / message queue
  • parallel - Execute jobs in parallel using one or more computers
  • Serf - Decentralized solution for service discovery and orchestration
  • SmartStack - Automated service discovery and registration framework, by Airbnb
  • vulcand - Programmatic extendable proxy for microservices and API management
  • Webjob - Downloads a program or script from a remote WebJob server, executes it, and sends back output to a server
  • xCAT - Complete management solution for distributed systems
  • Zookeeper - Distributed configuration service, synchronization service, and naming registry

File Sync and Sharing

  • BitTorrent Sync (btsync) - Sync on the local network or over the internet -- closed source
  • Cloud Explorer - GUI to access storage on multiple clouds, for Windows -- freeware, closed source
  • Heartbeat - Uses an ID rather than an IP address, share your ID with friends and go. Formerly Syncthing, formerly Pulse
  • ownCloud - The most popular file sync and share program
  • Pydio - Formerly AjaXplorer, AGPL license
  • Seafile - Also offers a paid professional edition with more features
  • SparkleShare - Uses git under the hood
  • Syncany - Supports tons of different protocols for the transfer
  • Tahoe-LAFS - Free and open decentralized cloud storage system
  • Unison - Multiplatform, feature-rich file sync

High Availability Clustering Tools

  • AN! Cluster Tutorial 2 - Building clusters with OSS software, very detailed, highly recommended
  • Corosync - HA framework and cluster engine
  • csync2 - Cluster file sync tool
  • Distributed Replicated Block Device (DRBD) - Mirror block devices to a remote system
  • HAproxy - Open source software load balancer
  • haproxyctl - Wrapper to talk to the HAProxy socket, as well as regular init (start stop restart) shit
  • Hipache - Distributed HTTP and websocket proxy, supports load balancing
  • keepalived - Load balancing and high availability
  • huptime - Zero downtime restarts of unmodified programs
  • Linux-HA - Building blocks for high availability systems
  • Pacemaker - HA resource manager
  • Spread - Fault resilient message bus
  • UCARP - VIP management using the CARP protocol
  • Vippy - VIP management, written in node.js

High Performance Computing Tools

HTTP Load Generation Tools

  • Gatling - HTTP, JMS, and WebSocket load generator
  • FunkLoad - Functional and load web tester, written in Python
  • httperf - HTTP load generator, originally created, by HP
  • httping - Simple program that "pings" a URL and shows response time
  • JChav - Visualize JMeter output
  • JMeter - Designed to load test functional behavior and measure performance, written in Java
  • Locust - Written in Python, allows you to define user behavior
  • Siege - CLI based, supports basic authentication, cookies, and HTTPS
  • Tsung - Distributed stress tester, also supports stress testing DBs
  • vegeta - Written in Go
  • Web Performance Today - News site dedicated to web / HTTP performance
  • wrk - Multi-threaded CLI tool
  • wrk2 - Fork of wrk that fixes the coordinated omissions problem

IO Load Generation Tools

Logging and Log Management

  • Adiscon LogAnalyzer - Slick web interface for syslog messages
  • ElasticDump - Import / export tools for Elasticsearch
  • Elasticsearch - Component of the ELK stack, used for super fast searches
  • elasticsearch-river-email - E-mail river plugin for Elasticsearch
  • Elasticsearch Copier (escp) - Tool to copy elasticsearch indexes, great for copying from prod to dev
  • Elasticsearch Exporter - Small script to export data from one Elasticsearch cluster into another
  • Errbit - Tool for collecting and managing errors from other application, Airbrake API compliant
  • FileSystem River (fsriver) - Elasticsearch river plugin helps to index documents from your local file system and using SSH
  • Fluentd - Unified logging layer
  • Flume - Distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of log data
  • Graylog2 - Log capture and analysis
  • Heka / hekad - Stream processing, can gather logs or performance metrics
  • IRCcat - Send log messages and alerts to an IRC channel, can also use IRC to send commands
  • Log Courier - Enhanced fork of Logstash Forwarder
  • Logplex - Distributed syslog log router, uses Redis
  • logstash - Collect, parse, and store logs. A component of the popular ELK stack
  • logstash-forwarder - Formerly Lumberjack, forwards logs to centralized server(s), very lightweight
  • Logster - Utility for reading log files and generating metrics to configurable outputs by Etsy
  • Logwatch - Monitor logs and send an e-mail when event(s) occur
  • multilog - Reads a sequence of lines from stdin and appends selected lines to any number of logs
  • multitail - Monitor multiple log files in a single terminal window
  • NXLOG - Universal log collector and forwarder, supports many formats/platforms/sources including Windows
  • Piwik - Web analytics platform with a killer UI
  • Sentry - Application exception logging
  • Simple Event Correlator (SEC) - Event correlation tool for advanced event processing
  • swatch - Simple watcher
  • Webalizer - Web and FTP log analyzer

Metric Collection Analaysis and Storage

  • collectd - Collects system performance statistics
  • collectd Related Sites - Great tools that integrate with collectd
  • collectd-openstack - collectd plugin for monitoring OpenStack components
  • collectl - sar on steroids
  • Diamond - Python daemon that collects system metrics and publishes them to Graphite (or similar), has an API
  • dim_STAT - Collects almost everything and stores it in a MySQL database, produces reports too
  • FastForward - Flexible system event and metric forwarding agent by Spotify
  • Graphite - Store numeric time-series data and render graphs of the data on demand
  • Graphite Tools - Tools that work with Graphite
  • Heka / hekad - Stream processing, can gather logs or performance metrics
  • InfluxDB - Distributed time series database with no external dependencies
  • kairosdb - Time series DB written on top of Cassandra
  • Node-Bell - Real-time anomalies detection system for periodic time series
  • OpenTSDB - Store and serve massive amounts of time series data without losing granularity
  • RRDtool - High performance data logging and graphing system for time series data
  • Scales - Metrics collection, written in Python
  • Skyline - Real-time anomaly detection system to enable passive monitoring of metrics without the need to configure thresholds
  • sysinfo_influxdb - Collect system metrics and store them in an InfluxDB server

Monitoring and Alerting

  • Adagios - Web based Nagios configuration interface
  • bluepill - Simple process monitoring, written in Ruby
  • Bosun - Monitoring and alerting system written by Stack Exchange
  • Cabot - Self-hosted, easily-deployable monitoring and alerts service - like a lightweight PagerDuty
  • check_mk - Extensions / plugins for Nagios
  • check_mk Multisite - GUI for check_mk
  • Daemon Tools - Service monitoring and management tools by DJB
  • FastForward - Flexible system event and metric forwarding agent by Spotify
  • Flapjack - Alert routing and rollup so you don't get tons of alerts for large failures
  • Fully Automated Nagios - Easy to install, pre-packaged Nagios that includes the most-used tools and plugins
  • Ganglia - Monitoring software that's focused on HPC / distributed clusters
  • Icinga - Nagios fork, updated frequently
  • Icinga2 - Complete re-write of Icinga
  • jmxtrans - Connector between speaking to a JVM via JMX on one end and whatever logging / monitoring / graphing package
  • Kale - Monitoring stack by Etsy
  • LibreNMS - GPL fork of Observium
  • Monit - Includes tools to automatically take action when certain conditions are met
  • Monitorix - So lightweight that it can be used in mobile devices, aka Mikaku
  • Multi Router Traffic Grapher (MRTG) - Still being updated!
  • Naemon - Modular Nagios fork
  • Nagios - One of the most widely used OSS monitoring programs
  • nagios-herald - Gives context to Nagios alerts, by Etsy
  • NeDi - Network discovery and monitoring
  • OpenNMS - Network monitoring, also supports configuration/asset management
  • Open Monitoring Distribution (OMD) - Nagios bundled with the most popular plugins and tools
  • OpsView Core - GPL version of OpsView, not as feature-rich as the commercial product
  • Packetbeat - Distributed packet monitoring system that can be used for application performance management
  • pmacct - IP and network traffic accounting / monitoring
  • Prometheus - An open-source service monitoring system and time series database
  • Riemann - Aggregates events from your servers and applications with a powerful stream processing language, for distributed systems
  • Sensu - Open source monitoring framework, cloud-focused
  • Shinken - Compatible with Nagios
  • StatsD - Monitoring in node.js bu Etsy
  • Tattle - Self service alerting and dashboard frontend for Graphite and Ganglia
  • Uptime - Remote monitoring application using Node.js, MongoDB, and Twitter Bootstrap
  • Xymon - Fork of Big Brother
  • Zabbix - Stores monitoring data in a DB, has agents for almost every OS
  • Zenoss - Supports Nagios plug-in format

Network Load Generation Tools

  • Flent - Python wrapper to run mutliple netperf/iperf3/ping in parallel, formerly netperf-wrapper
  • Flowgrind - Distributed TCP traffic generator
  • iperf3 - Supports tuning of various parameters related to timing, protocols, and buffers
  • netperf - The web page looks ancient but the software's still being updated!
  • ostinato - Packet crafter/traffic generator and analyzer with a friendly GUI

Networking Tools

  • Audit Record Generation and Utilization System (ARGUS) - Generates network activity reports
  • Augmented Traffic Control (ATC) - A tool to simulate network conditions, by Facebook
  • bbcp - Copies files using multiple TCP streams to greatly increase throughput
  • bbFTP - Uses it's own transfer protocol, optimized for large file transfers
  • BIRD Internet Routing Daemon (BIRD) - (Almost) fully functional IP routing daemon for Linux, supports tons of standard routing protocols
  • Charles Web Debugging Proxy - Highly recommended, includes support for decoding HTTPS traffic and throttling -- commercial software
  • Comcast - Simulate crappy network connections
  • curlish - Improved curl, includes cookie management and OAuth support
  • dummynet - Simulates/enforces queue and bandwidth limitations, delays, packet losses, and multipath effects
  • FaceBook Open Switching System (FBOSS) - FB's software stack for managing and controlling whitebox switches
  • fping - High performance ping (ya, really)
  • ipcalc - CLI tool to calculate subnets, netmasks, IP ranges, broadcast addresses, and more
  • iptstate - A top-like display of IP Tables state table entries
  • GridFTP - Supports parallel streams
  • httpdiff - Perform the same reuqest against two HTTP servers and diff the results
  • httpie - curl replacement with many new features
  • intrace - Enumerate IP hops using existing TCP connections
  • lftp - Supports many protocols (FTPS, HTTPS, SFTP), scheduling, bandwidth throttling, scripting, and more
  • localtunnel - Share a web service on your local development machine without messing with DNS and firewall settings
  • mitmproxy - Intercept, modify, replay and save HTTP/S traffic, edit flows on the fly
  • moloch - Large scale IPv4 full PCAP capturing, indexing and database system
  • mountebank - Stub downstream resources for testing, supports HTTP HTTPS SMTP TCP
  • mtr (My traceroute) - Combines ping and traceroute into a single program
  • multicast remote sync (mrsync) - Transfers from a master to many remote machines using Unix multicast sockets
  • namebench - Hunts down the fastest DNS servers for your computer to use
  • ncat - Improved netcat, written by the Nmap team
  • netbrake - Limit the bandwidth used by a process
  • Netdisco - Web-based network management tool, written in perl, uses SNMP
  • Network Link Conditioner - Simulate bandwidth, latency, and packet loss. For OS X
  • nfdump - Captures network flows
  • NfSen - GUI for nfdump
  • ngrep - Network grep
  • nping - Create custom network packets
  • ntopng - New version of the popular ntop tool
  • OpenResty - Turn nginx into a non-blocking API server
  • Paris Traceroute - Shows proper network topology when load balancers and load-balanced routers are used
  • PageKite - Makes web servers or SSH publicly available on any server
  • POSTman - Create and share HTTP requests, great for testing APIs - Chrome plugin
  • prettyping.sh - bash wrapper for ping to create pretty output
  • Quagga - Routing software suite, supports most routing protocols
  • Repose - REST proxy
  • scapy - Interactive packet manipulation tools written in Python
  • Sloppy - Proxy server that slows down connections for testing
  • socat - netcat on steroids, supports serial devices
  • spiped - Create encrypted pipes between socket addresses using PSKs, similar to ssh -L
  • sslh - Protocol multiplexer, forwards packets based on the first packet
  • Stanford Linear Accelerator Center - Network Monitoring Tools - MASSIVE list of network monitoring tools
  • tc - Built-in Linux kernel traffic control
  • tcpdstat - Get protocol statistics from tcpdump / PCAP files
  • tcpflow - TCP demultiplexer, each flow is stored in it's own file
  • TCPWatch - TCP monitoring and logging tool
  • tengine - A distribution of Nginx with some advanced features, by Alibaba
  • Tracebox - Detect middleboxes (NAT, transparent proxies, etc) in a network path
  • trickle - Userspace bandwidth shaper
  • UDR - UDT wrapper for rsync that improves throughput of large data transfers over long distances
  • Varnish - Caching HTTP accelerator
  • WANem - WAN emulator for testing response over low bandwidth and/or high latency connections
  • WireShark - The classic network analyzer
  • WireShark Tools - Superb list of network tools from the WireShark wiki
  • Yconalyzer - Monitor and analyze TCP connections
  • Your Own URL Shortener (YOURLS) - Lets you run your own URL shortener a'la TinyURL or bit.ly
  • ZeroTier - Cloud / provider-agnostic private network backplanes

Packages and Repositories

  • Aminator - Create application-specific custom AMIs, by Netflix
  • apt-dater - ncurses frontend for package management via SSH, also supports yum
  • aptly - Debian-centric, includes repo support and the ability to take snapshots for easy rollback
  • CentOS Errata for Spacewalk (CEFS) - Import errata information from CentOS-announce into Spacewalk
  • CentOS Repositories - Large list of both official and unofficial CentOS software repositories
  • CentOS Software Collections (SCL) - Use multiple versions of software on a system without disturbing the system default version
  • Copr - Automatic build system providing a package repository as its output
  • cowbuilder - Package builder that uses copy-on-write (COW) to speed up the build process
  • DNF - Package management system that will replace Yum in upcoming Fedora releases
  • Effing Package Management (fpm) - Build packages for multiple platforms (deb, rpm, etc) with great ease and sanity
  • ELRepo - Repo that focuses on hardware related packages, supports RHEL and CentOS
  • Extra Packages for Enterprise Linux (EPEL) - Supports CentOS, RHEL, Scientific Linux, and Oracle Linux
  • Extra Packaging Guidelines and Policies for EPEL - Packaging guidelines, great even if not creating EPEL stuff
  • Fedora Packaging Guidelines - Excellent information that can be applied to CentOS & RHEL
  • fpm-cookery - Tool for building software packages with FPM
  • IUS SafeRepo Initiative - Create "safe" 3rd party repos
  • Koji - Software that builds packages for Fedora, can be used for other stuff too, uses mock
  • Mock - Build packages in a simple chroot so you don't blow up your system
  • mrepo - Yum & APT repository mirroring, formerly Yam
  • OStree - Tool for managing bootable, immutable, versioned filesystem trees (not really a package manager but...)
  • Package Repository Manager (PRM) - OS-independent package repository tool
  • pkgr - Made deb or RPM packages out of any Ruby, NodeJS, or Go app
  • Pulp - Next generation repository management, a component of Red Hat Satellite 6
  • Red Hat Software Collections (SCL) - Use multiple versions of software on a system without disturbing the system default version
  • reposync - Synchronize yum repositories to a local directory
  • rpm-ostree - Take RPM packages and commit them to an OSTree repository
  • RPM Fusion - Provides software that the Fedora Project or Red Hat doesn't want to ship
  • schroot - Allow non-root users to create chroot environments, great for package testing
  • Spacewalk - Provides package management (among other things)
  • yum-presto - yum plugin that provides support for downloading package deltas instead of whole packages
  • yum-security - Plugin to only install security updates

Password and Secret Management

  • 1Password - Password manager for OS X, Windows, iOS, and Android -- closed source
  • blackbox - Safely store secrets in Git
  • ccrypt - Replacement for the standard Unix "crypt" utility
  • Diceware - Neat passphrase generator
  • GNU Privacy Guard (GPG) - The original! Store em in text files and encrypt
  • GRC Password Generator - Generates 63 bit passwords, web based
  • KeePass - Lightweight, easy to use password manager, runs on most OSes, requires MONO for non-Windows systems
  • Keepass2Android - Compatible with KeePass 2.x, requires MONO
  • KeePassDroid - Compatible with KeePass 1.x
  • KeePassX - Alternative to KeePass, requires QT
  • Keywhiz - A system for distributing and managing secrets (API keys, certificates, etc)
  • kpcli - Command line interface for KeePass
  • LastPass - Freemium, can sync to other devices -- closed source
  • lastpass-cli - CLI for LastPass
  • msktutil - Keytab client for a Microsoft Active Directory environment
  • One-Time Secret - Create links that self-destruct after a single viewing, great for sharing passwords
  • pass (passwordstore) - Uses GPG at it's core, supports tracking password changes in git
  • passff - Firefox addon for interacting with the a pass/passwordstore repository
  • Password Gorilla - Written in Tcl/Tk
  • Password Pusher - Links to passwords expire after a certain number of views and/or time has passed, RoR app
  • Password Safe - Designed by Bruce Schneier himself
  • Pleasant Password Server - Multi-user management tool for KeePass, great for businesses -- commercial software
  • pwd.sh - Script to manage passwords in an encrypted file using GPG
  • pwgen - Password generated, included in most Linux distros
  • RatticDB - Web-based password management, includes an API, great for teams or companies
  • scrypt - Super secure against hardware brute-force attacks, is also a part of/module for most programming languages
  • TeamPass - Collaborative password management using the LAMP stack
  • Vault - Tool for storing secrets (API keys, passwords, certs, etc) by Hashicorp
  • webpasswordsafe - Very powerful, designed "for the enterprise"
  • zxcvbn - Password strength estimator, written by Dropbox, operates in a browser window

Performance Monitoring

  • apachetop - top for Apache
  • atop - Supports both real-time and historical erformance monitoring
  • bandwidthd - Monitors and graphs bandwidth usage
  • blktrace - Article on blktrace, includes tldr setup steps in the comments
  • bmon - Console based network monitor
  • bwm-ng - Small and simple console-based live network and disk I/O bandwidth monitor
  • Conky - Lightweight system monitor for X windows
  • dstat - Versatile replacement for vmstat, iostat, netstat and ifstat
  • ESnet Fasterdata Knowledge Base - Provides proven, operationally sound methods for troubleshooting and solving performance issues
  • EtherApe - Graphical network monitor, pretty output
  • findswappers - perl script that identifies swapped processes
  • ftptop - Monitor FTP connections in real time
  • Glances - Real-time performance monitoring, written in curses and Python
  • gt5 - A "du browser", handy for finding large files
  • htop - top replacement, has a few additional features
  • iftop - top for network interfaces
  • ioping - Monitor I/O latency in real time
  • iotop - top for I/O requests, displays information on a per-process basis
  • iptraf - A top'esque program for network traffic, has multiple display modes, written in ncurses
  • Linux Performance Observability Tools - Awesome graphic that shows you which tool to use, by Brendan Gregg
  • mem_logger.sh - Monitor a processes' memory usage over time
  • Munin - Historical performance monitoring to help determine when you server became "slow"
  • nbwmon - Ncurses bandwidth monitor
  • ncdu - ncurses version of "du"
  • netatop - Kernel module for atop to watch and report on network packets
  • NetHogs - Displays per-process bandwidth usage
  • ngxtop - top for nginx
  • nicstat - vmstat for network interfaces
  • nload - Console application that monitors network traffic and bandwidth usage in real time, neat ASCII graphs
  • nmon - Provides both real-time and historical performance metrics
  • PageSpeed Module - Reduce page load time without modify your existing content or workflow
  • perf-tools - By Brendan Gregg, uses perf and ftrace, includes iosnoop, KILLER TOOLS
  • Performance Co-Pilot (PCP) - System performance and analysis framework, included in RHEL 7
  • pidstat - vmstat type output for CPU, disk I/O, page faults, and more on a per-process basis
  • pmap - Shell scripts for tracking memory usage using "pmap"
  • PowerTOP - Real-time power consumption on a per-process & per-thread basis
  • ps_mem - Accurately reports core memory usage for a process
  • ptop - top/ntop-like task monitor written in Python
  • recap - Collects info from various standard utilities (free, sar, vmstat, etc) at specified intervals
  • saidar - ncurses based program for viewing system statistics
  • slabtop - Tutorial on how to use slabtop, useful when you have no idea on how your RAM is being used
  • smem - Reports memory usage based on proportional set size (PSS) instead of the usual resident set size (RSS)
  • ss - Socket statistics, a better netstat
  • sysdig - "Think of it as strace + tcpdump + lsof + awesome sauce.", recommended
  • SmokePing - Network latency visualizer, written by the MRTG and RRDtool guy
  • USE Method - Brendan Gregg's rosetta stone for performance analysis and tuning
  • vnStat - Console based traffic monitor, supports statistic collecting
  • wtop - Another top for Apache

Provisioning and Lifecycle Management

  • Bento - Encapsulates Packer templates for building Vagrant baseboxes, used by Chef
  • Box-Cutter - Templates and tools for creating OS environments using Packer, by Hashicorp
  • cloud-init - Configures settings the first time a system spins up (SSH keys, hostname, etc)
  • Cobbler - Provisioning system used in Red Hat's Satellite
  • Crowbar - Multi-purpose provisioning tool, created by Dell
  • edeploy - Tool to provision and update systems using trees of files instead of packages or VM images
  • Foreman - Provisioning and life cycle management
  • iPXE - GPL'ed version of PXE, replacement for gPXE
  • Jeto - Control multiple VMs on a headless server using Flask and AngularJS
  • Katello - Candlepin + Pulp + Foreman, the core of Red Hat Satellite 6
  • Kickstart - The classic Red Hat tool
  • Metal as a Service (MaaS) - Ubuntu provisioning system
  • Overcast - VM orchestration and provisioning for DigitalOcean, Linode and Amazon, or locally using Vagrant + Virtualbox
  • Packer - Automates VM creation for multiple platforms (VMware, AWS, etc), can use a "golden image" approach
  • Pallet - Aims to solve the problem of providing a consistently configured running image across a range of clouds
  • Razor - Puppet provisioning software that handles bare metal hardware and virtual server provisioning
  • Sandstorm - Download, install, and run apps in a container
  • Terraform - Infrastructure provisioning using existing tools, supports many providers (AWS, Azure, DO, OpenStack, etc)
  • Vagrant - Quickly spin up environments for local testing and development
  • vagrant-cachier - Creates a common cache among all Vagrant boxes to reduce the amount of downloading
  • Vagrant Manager - GUI to manage Vagrant boxes, supports Windows and OS X
  • veewee - Easily (and repeatedly) build custom Vagrant base boxes, KVMs, and VM images
  • veewee-to-packer - RubyGem that will translate Veewee templates to Packer templates
  • VMFest - Turn VirtualBox into a light-weight cloud provider

Python Tools and Resources

  • 2.7 and 3.x Differences - The differences between 2.7 and 3.x with examples, via Hacker News
  • Awesome Python - Very large list of Python resources
  • bpython - Killer interface for the Python interpreter
  • Common Python Mistakes - Link and discussion on Hacker News
  • IPython - Interactive Python, like a shell or environment
  • Jinja2 - Templating language for Python
  • Micro Python - Python for microcontrollers and embedded systems
  • Parallel Python - Provides a mechanism for parallel execution of Python code on SMP and clusters
  • Python Package Index (PyPI) - Software repo for Python packages, like Ruby gems
  • Python Reference - A collection of useful scripts, tutorials, and other Python-related things
  • PyPy - Python alternative with advance features (JIT compiles, sandboxing, etc)
  • Requests - Killer replacement for the urllib2 module
  • virtualenv - Tool to create isolated Python environments
  • xlwings - Replace your Excel VBA code with Python

Python Tutorials

RDBMS Load Generation and Performance Tools

RDBMS Tools

  • Adminer - GUI for database management in a single PHP
  • Flyway - Version control for DB schemas, supports most DBs, highly recommended
  • Galera Cluster - HA clustering for MySQL
  • HeidiSQL - GUI SQL DB browser and editor
  • migrit - Iterative schema migrations for MySQL
  • MariaDB Galera Cluster - HA for MariaDB
  • MySQL Data Dumper (mydumper) - Much better than mysqldump
  • Navicat - GUI for RDBMS administration and development, RECOMMENDED -- commercial software
  • Percona XtraDB Cluster - HA clustering for MySQL / MariaDB, supports active/active
  • pg_shard - PostgreSQL extension to scale out real-time reads and writes
  • pgBadger - PostgreSQL log analyzer
  • pgcli - Postgres CLI with autocomplete and syntax highlighting
  • pgloader - Fast data loader for PostgreSQL
  • Postgres-XL - Scale-out version of PostgresSQL
  • rdbms-subsetter - Generate a random sample of rows from a relational database that preserves referential integrity, great for using production data for testing/dev
  • SQL Fiddle - Write and test SQL
  • WebScaleSQL - Huge scale MySQL with contributions from Facebook, Google, LinkedIn, and Twitter

Regular Expressions

Ruby Tools and Resources

  • Awesome Ruby - A collection of awesome Ruby libraries, tools, frameworks and software
  • Bundler - Manage Gem dependencies
  • did_you_mean - Suggestions for typos in Ruby code
  • fog - Cloud services library for Ruby
  • Omniref - A better search site for Ruby documentation
  • Pry - IRB alternative, very feature-rich
  • Rake - Make / Makefile-like build utility
  • rbenv - Alternative to RVM
  • replicate - Dump and load relational objects between Ruby environments (eg: prod and dev)
  • RSpec - Behavior-driven development (BDD) testing framework
  • RuboCop - Static code analyzer that enforces guidelines
  • Ruby Gems - The Ruby package manager. Gems = libraries
  • Ruby Toolbox - Trillions of Ruby projects, categorized
  • Ruby Version Manager (RVM) - Install, manage, and work with multiple Ruby environments

Ruby Tutorials

Security Tools

Shell Scripting

  • Advanced Bash-Scripting Guide - By the Linux Documentation Project (LDP)
  • Bash Hackers Wiki - Human-readable bash documentation so you don't have to dig through the man page
  • bro pages - Simplifed man pages and examples
  • CommandlineFu - Killer code snippets
  • Explain Shell - Enter a command-line to see the help text that matches each argument
  • Fu - CLI for CommandlineFu.com, allows for easy searches
  • ShellCheck - Checks shell scripts for common mistakes
  • tldr - Simplified and community-driven man pages, cuts out a lot of cruft
  • The Art of Command Line - Master the command line, in one page
  • Unix Rosetta Stone - The one and only resource for a mixed Linux/Unix environment
  • Unix Toolbox - A collection of Unix/Linux/BSD commands and tasks for advanced users

SSH Tools

  • autossh - Automatically restart SSH sessions that stop passing traffic
  • Balancing Load Across Systems (Ballast) - Balance user load across SSH servers based on configured policies
  • Bitvise SSH Client - Feature-rich SSH & SFTP client for Windows, free for individual use -- closed source
  • Byobu - An enhanced version of the "screen" utility
  • cloud-ssh - SSH wrapper that supports hostname tab-completion based on name, tag, or security group
  • ClusterSSH - Make a change on many servers at the same time
  • Corkscrew - Tunnel SSH through HTTP proxies
  • csshX - Cluster SSH for OS X
  • Dancer's Shell (dsh) - Wrapper for executing multiple remote shell (rsh/remsh/ssh) commands
  • FileZilla - The best GUI file transfer client, supports scp -- WARNING saves passwords in plain text
  • Guacamole - Clientless (in-browser) remote desktop gateway, supports VNC, RDP, and SSH
  • HPN-SSH - High performance ssh/scp (auth handshake is encrypted, data transfer is not)
  • KeyBox - Web-based SSH console that executes commands on multiple shells
  • Keychain - frontend to ssh-agent and ssh-add, reduces the number of times you have to type in your passphrase
  • KiTTY - PuTTY fork with additional features
  • Mass Parallel SSH (mpssh) - Simple parallel SSH
  • Match - Creates a conditional block, great for controlling actions on a per-user and/or per-host basis
  • MobaXterm - Tabbed SSH, VNC, and RDP client for Windows, free for personal use -- closed source
  • Mobile Shell (Mosh) - Remote shell that supports roaming (client IP address changes) and intermittent connectivity
  • mRemoteNG - Open source, tabbed, multi-protocol, remote connections manager
  • MTPuTTY (Multi-Tabbed PuTTY) - Multiple PuTTY sessions in a single window
  • MUltihost SSH Wrapper (Mussh) - SSH wrapper
  • NoVNC - Client-less VNC in a web browser, uses HTML5 and WebSockets
  • parallel-ssh (pssh) - Parallel version of OpenSSH tools, comes with prsync too
  • Parallel Distributed Shell (pdsh) - Kick off many SSH sessions in parallel
  • paramiko - SSH2 protocol library for Python, provides both client and server
  • Parcel - High performance scp replacement, WARNING: uses UDP
  • PuTTY - The classic SSH client for Windows
  • rssh - Restricted shell for SSH, only allows scp, sftp, rdist, rsync, and cvs
  • scponly - Shell that only allows incoming SCP, supports chroot
  • SSH Power Tool (sshpt) - Execute commands and upload files to many servers simultaneously via SSH without using pre-shared keys
  • ssh-ldap-helper - Store public keys in LDAP
  • SSHFS - Mount remote file systems using a SSH tunnel
  • sshrc - Sources the ~/.sshrc on your local computer after logging in remotely
  • sshuttle - Transparent proxy server that works as a poor man's VPN, forwards over SSH, supports DNS tunneling
  • SuperPutty - Allows the PuTTY SSH client to be opened in tabs
  • tmux - An alternative to GNU screen
  • tmux-cssh - Cluster SSH for tmux
  • WinSCP - The well-known SCP client for Windows
  • x2go - One of the best remote-desktop-over-SSH clients
  • Xming - Windows Xwindows server, supports PuTTY

SSL TLS HTTPS Tools

  • BoringSSL - Google's fork of OpenSSL, does not guarantee API and ABI compatibility
  • cipherscan - Find out which SSL ciphersuites are supported by a target
  • duraconf - A collection of hardened configuration files for SSL/TLS services by Jacob Appelbaum
  • HTTP Strict Transport Secuirity (HSTS) - Forces browsers to interact with a site by only using HTTPS
  • LibreSSL - OpenBSD's fork of OpenSSL, Linux compatible
  • Mozilla SSL Configuration Generator - Generate SSL configs for Apache, Nginx, ELB, HAproxy and more
  • nogotofail - Spot and fix weak TLS/SSL connections and sensitive cleartext traffic
  • Qualys SSL Server Test - Evaluates and provides recommendations for the SSL settings of any web site
  • Server Name Indication (SNI) - Think vhosts for SSL
  • sslconfig - CloudFlare's Internet facing SSL cipher configuration
  • sslsniff - A tool for automated MITM attacks on SSL connections
  • SSLsplit - Transparent and scalable SSL/TLS interception
  • sslyze - Fast and full-featured SSL scanner, written in Python
  • SSL Decoder - Decodes a SSL connection and displays certificate information

Software Development Tools

  • ack - grep-like tool designed to search source code
  • Artifactory - Probably the best way to store software artifacts and deal with dependency hell
  • Barkeep - Code review tool, kinda sorta like GitHub
  • BFG Repo-Cleaner - Scrub large blobs and sensitive data from git history
  • boar - Stores snapshots of directory trees in a local or remote repository, for BLOBs
  • Buildbot - CI framework
  • Codeine - CD with built in monitoring and automation
  • comm - Display lines that two files have in common (eg: the opposite of diff)
  • Completion - Tab completion for git branches, supports various shells
  • cwrap - Wrappers for creating test scenarios and faking behavior, recommended
  • devcheatsheet.com - Cheat sheets and quick references for almost every programming language
  • drone - CI platform built on Docker
  • Elita - API based CD framework/engine that uses git and Salt
  • Environment Modules - Dynamic modification of your shell environment using modules
  • fig - A way to create "environments" for developers (dependencies, etc)
  • FindBugs - Static code analyser for Java
  • GistBox - Web UI for organizing Gists
  • git-arr - Repo browser that uses static HTML pages for reduced overhead
  • git-fat - Like git-media but without the Ruby dependencies
  • git-media - Use Git with large BLOBs without storing the BLOBs in Git itself
  • GitBucket - GitHub clone written in Scala
  • GitHub Pull Request Builder Plugin (gprbp) - Allows certain comment strings to kick off builds
  • GitLab - Kinda like an open source GitHub
  • GitLab CI - CI that integrates with GitLab
  • Gitorious - Web front end for git, can be deployed as an appliance
  • GitTorrent - A decentralization of GitHub using BitTorrent and Bitcoin/blockchain
  • gitwatch - Automatically commit changes when specified files or directories are modified
  • Git Interfaces, Frontends, and Tools - Massive list on the kernel.org wiki
  • gkv - Use git as a KV key/value store
  • Gource - Software version control visualization tool
  • Hubot - Chat bot that can do deploys, look up images, integrate with Google Maps, and tons of other stuff
  • Imhotep - Comments on commits coming into your repository and checks for syntactic errors and general lint warnings
  • Jenkins - The most popular CI orchestration tool, supports a billion plugins
  • Jenkins JobConfigHistory - Tracks changes to system and job configurations
  • Jenkins Job DSL Plugin (jenkins-job-dsl) - Groovy-based DSL for writing Jenkins jobs
  • JSON Formatter - Automatically format JSON code, 100% client side
  • libgit2 - Library for interfacing with git via Ruby, Python, Go, and others
  • Mergeatron - Kicks off Jenkins a repo gets a PR, gives a thumbs up/down reply
  • myrepos - Flexible tool for managing many repos
  • Ninja - Small build system with a focus on speed
  • PatchELF - Simple utility for modifying existing ELF executables and libraries
  • Phabricator - Suite of web-based software development collaboration tools
  • Phare - Static code analysis
  • PRoot - User-space version of chroot, great for testing and development
  • Pushpin - Proxy server that adds WebSockets to existing request-response APIs
  • Review Board - Code review tool for multiple SCM systems
  • RocksDB - Library that provides an embeddable, persistent key-value store for fast storage - by Facebook
  • Silver Searcher, The (aka ag) - Source code searching tool, similar to "ack" but faster
  • SonarQube - Platform / dashboard for managing code quality
  • Swagger - A JSON format/standard that describes a RESTful API
  • tortilla - Easily wrap web APIs, written in Python
  • tup - Super fast and efficient build system
  • watch-make - Monitor Makefile dependencies and kick off make when one changes
  • watchman - Watch files and take action when they change (eg: kick off the CI system)

Storage Tools

  • ATA Secure Erase - Send a signal to an ATA drive to perform a hardware-based erase
  • CockroachDB - Open source version of Google's Spanner storage system
  • EnhanceIO - SSD caching, in the mainline Linux kernel, a fork of Facebook's Flashcache project
  • fs-cache - NFS client caching
  • IPOS Calculator - Created by Marek Wolynko
  • Linux-IO Target (LIO) - Create and share iSCSI, FC, FCoE, and other storage targets on Linux
  • Linux Journal - Linux Swap Space - Superb article about Linux swap, includes some tuning parameters
  • lsblk - List block devices
  • lvcache - Wrapper to help you create and manage LVM caches
  • OpenDedupe - Open source dedupe software, works on both block storage and file systems
  • Parted Magic - Resize, grow, shrink, clone, recovery, wiping, benchmarking, and more. Supports Linux and Windows file systems.
  • Red Hat LVM RAID Calculator - Login required
  • snapper - CLI tool to manage Btrfs snapshots, snapshot timelines, and more
  • System Storage Manager (SSM) - Generic CLI for managing all types of storage (DM, LVM, multipath), added in RHEL 7

Text Editors IDEs and Related Tools

  • Atom - Superb text editor, created by GitHub
  • Atom Linter - A collection of lint tools for the Atom editor\
  • Eclipse - The well known Java IDE
  • Etherpad - Enter, save, and share text/code in a web browser
  • HasteBin - Open source pastebin alternative for sharing code, can be installed locally / on-site
  • LargeFile - vim plugin that automatically disables certain things so you can edit large files faster
  • Notepad++ - Killer GPL'ed text editor for Windows
  • percol - Interactive grep tool
  • Sticky Notes - On-site / local pastebin
  • Sublime Text - Ok it's closed source and costs money but it's probably the best one out there
  • vim-json - A better JSON plugin for vim

Tracing Debugging Profiling

Two Factor Authentication

  • Authy - Provides both personal and enterprise versions
  • Barada Aint Respecting Any Deceptive Adversaries (BARADA) - PAM module for TFA support
  • Crypto Stick - OTP and more -- commercial products
  • Duo Security - Cloud-based, supports many methods of authentication (hard token, smartphone application, etc) -- commercial product
  • FreeOTP - Open source fork of Google Authenticator for iOS and Android
  • Google Authenticator - Two factor authentication; supports Android, iOS, and even has a PAM module -- closed source
  • Two Factor Auth (2FA) - Massive list of web sites that support and don't support two factor authentication
  • YubiKey - Acts as a USB keyboard to automatically input a strong, one time password -- commercial product
  • Yubico PAM - PAM module for use with YubiKey devices

Virtualization

Misc Tools and Utilities

  • appscale - Open source implementation of Google App Engine
  • AutoHotKey - Automate input (desktop and web forms, data entry, keybinds, etc)
  • autojump - Small database of directories that you visited in the past, used to quickly navigate complex directory structures
  • Awesome - A curated list of awesome lists
  • Bento - Links to tutorials based on subject (programming, sysadmin, protocols, standards, etc)
  • Checkpoint/Restore in Userspace (CRIU) - Freeze a process, save it to disk, then resume it later
  • conserver - Virtual console server with many features
  • Cygwin - GNU shell and tools for Windows
  • Deltacloud - API that abstracts the differences between clouds (AWS, OpenStack, etc)
  • dotfiles - Store your .bashrc and others on GitHub
  • dtrx - Single command to extract almost any type of archive, requires Python 2.4+
  • eatmemory - Allocates X amount of memory, great for testing
  • etckeeper - Stores /etc in version control
  • f.lux - Changes your screen from blue light to yellow light when the sun sets to tell your brain it's night time -- closed source
  • Filewatcher - Written in Ruby, monitors changes in the file system by polling
  • ForgeRock - Enterprise identification management and access (IAM)
  • FreeIPA - Identity, policy, and audit suite, think Active Directory for Linux
  • gcalcli - CLI for Google Calendar
  • Geocities-izer - Make any web page look like a Geocities page
  • grabmem - Allocates memory until the machine runs out or you quit it with ctrl-c
  • incrond - Fires off a job when a file system event happens
  • ISO 8601 - ISO standard for dates, the only way to fly
  • inotify - Watch file(s) for changes, take an action when the change occurs
  • inxi - "a full featured system information script" (hardware info, etc)
  • jq - Command line JSON processor
  • Keybase - Upload your public key and find other people's public key via their social media user name(s)
  • Let's Chat - Self-hosted open source HipChat clone
  • mockaroo - Generate up to 100,000 rows of realistic test data in CSV, JSON, SQL, and Excel formats
  • moreutils - "Collection of the unix tools that nobody thought to write long ago when unix was young"
  • Netflix OSS - Netflix OSS tools on GitHub
  • observr - Monitor a directory and kick off an action when a file in the directory changes
  • pigz - Parallel gzip for multi-processor/core systems
  • pv - Shows the progress of data as it flows through a pipe
  • Rackerlabs - Rackspace's OSS tools, hosted on GitHub
  • rcron - cron redundancy and failover, ensures a job will only run on the "active" machine
  • Request Tracker - Bug tracking, help desk ticketing, customer service, workflow processes, change management and more
  • supervisord - Process control, kinda like an init replacement but not really
  • Synergy - Share a single keyboard and mouse with multiple physical computers
  • sysadmin-util - A collection of small but useful utilities
  • Tools of the Trade - Massive list of SaaS, via Hacker News
  • watchr - Monitor a directory tree and kick off a script when a file changes, written in Ruby

About

No description, website, or topics provided.

Resources

Stars

9 stars

Watchers

3 watching

Forks

Releases

Packages

Contributors