LucidBench: Docker Benchmark Framework

About

██╗     ██╗   ██╗ ██████╗██╗██████╗     ██████╗ ███████╗███╗   ██╗ ██████╗██╗  ██╗
██║     ██║   ██║██╔════╝██║██╔══██╗    ██╔══██╗██╔════╝████╗  ██║██╔════╝██║  ██║
██║     ██║   ██║██║     ██║██║  ██║    ██████╔╝█████╗  ██╔██╗ ██║██║     ███████║
██║     ██║   ██║██║     ██║██║  ██║    ██╔══██╗██╔══╝  ██║╚██╗██║██║     ██╔══██║
███████╗╚██████╔╝╚██████╗██║██████╔╝    ██████╔╝███████╗██║ ╚████║╚██████╗██║  ██║
╚══════╝ ╚═════╝  ╚═════╝╚═╝╚═════╝     ╚═════╝ ╚══════╝╚═╝  ╚═══╝ ╚═════╝╚═╝  ╚═╝

This project is developed and maintained by Shahab Afshar.

Professor: Dr. Mai Zheng

Course: Advanced Data Storage Systems
Department: Electrical and Computer Engineering (ECPE)
University: Iowa State University

Testbed: Chameleon Cloud
Chameleon Cloud is a large-scale, reconfigurable experimental environment for cloud computing research, providing researchers with bare metal access to explore novel cloud architectures and applications [1].

[1] K. Keahey et al., "Lessons Learned from the Chameleon Testbed," in Proceedings of the 2020 USENIX Annual Technical Conference (USENIX ATC '20), USENIX Association, July 2020.

LucidBench is A Docker-based filesystem benchmarking tool that automates the testing of different filesystems across various storage devices.

Features

• Automatic device detection and classification (HDD, SATA SSD, NVMe SSD)
• Support for multiple filesystem types (ext4, xfs, btrfs)
• Real-time system resource monitoring
• Docker-based benchmark execution
• Immediate result logging and monitoring

Prerequisites

• Linux-based operating system (Ubuntu 20.04 LTS or newer recommended)
• Docker Engine (version 20.10.0 or newer)
• Root/sudo privileges for device management
• Required system packages:
  • util-linux (for lsblk)
  • smartmontools (for smartctl)
  • sysstat (for iostat)
  • procps (for vmstat)
  • fio (Flexible I/O Tester)

Installation

1. Clone this repository:

git clone https://github.com/shahabafshar/LucidBench.git
cd LucidBench

Usage

You can run the project in two ways:

1. Using the main entry point (recommended):

sudo ./main.sh

2. Using the orchestrator directly:

sudo ./scripts/orchestrator.sh

The main entry point (main.sh) provides a fancy interface with ASCII art and runs the orchestrator script. The orchestrator script (orchestrator.sh) is the core component that coordinates the entire benchmarking process.

Results will be saved in the results directory, organized by device type and filesystem.

Project Structure

lucidbench/
├── config/
│   ├── Dockerfile
│   └── requirements.txt
├── scripts/
│   ├── orchestrator.sh
│   └── setup.sh
├── src/
│   ├── benchmark/
│   │   └── benchmark.py
│   ├── core/
│   │   └── device_detector.py
│   ├── monitoring/
│   │   └── monitor.py
│   └── utils/
├── results/
├── monitoring/
└── README.md

License

MIT License