Skip to content

Commit 2243704

Browse files
Ethics Team (#287)
Co-authored-by: Ben Stephens <ben.stephens@deakin.edu.au> Co-authored-by: ben-AI-cybersec <142491786+ben-AI-cybersec@users.noreply.github.com>
1 parent 7c554a9 commit 2243704

12 files changed

Lines changed: 314 additions & 5 deletions

File tree

.vscode/settings.json

Lines changed: 0 additions & 5 deletions
This file was deleted.
Lines changed: 105 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,105 @@
1+
---
2+
sidebar_position: 2
3+
---
4+
5+
Redback Dummy Data Generator – Implementation Guide
6+
7+
A Python-based tool designed to generate realistic dummy data across multiple file formats for testing the Redback Asset Assessment Tool (AAT). The generated files include a mixture of public and synthetic sensitive information to simulate real-world data repositories.
8+
9+
## Features
10+
11+
- Supports multiple file types: CSV, JSON, TXT, DOCX, and PDF
12+
13+
- Sensitivity levels: Low, Medium, High, Mixed
14+
15+
- Randomised file contents with realistic structure
16+
17+
- Console UI for interactive use
18+
19+
- Modular class-based architecture (DummyDataGenerator)
20+
21+
- Error handling for PDF generation edge cases
22+
23+
---
24+
25+
## Setup Instructions
26+
27+
1. Clone the Repository
28+
29+
- git clone https://github.com/Redback-Operations/redback-ethics.git
30+
- cd redback-ethics/dummy_data_generator
31+
32+
![Step 1 – Clone the Repository](./Photos/DumbyData1.png)
33+
34+
This image shows the README file for the “Redback Dummy Data Generator” project, providing an overview of its features and detailed setup instructions, including cloning the repository, setting up a virtual environment, installing packages, and running the generator via a Python script.
35+
36+
37+
38+
39+
2. Navigate to the Project Folder
40+
41+
- cd path/to/redback-ethics/dummy_data_generator
42+
43+
![Step 2 – Navigate to the Project Folder](./Photos/DumbyData2.png)
44+
45+
This image demonstrates how to clone the redback-ethics GitHub repository and navigate into the dummy_data_generator directory to begin setting up the project.
46+
47+
48+
49+
3. Create and Activate a Virtual Environment
50+
51+
- python3 -m venv .venv
52+
- source .venv/bin/activate
53+
54+
![Step 3 – Create and Activate a Virtual Environment](./Photos/DumbyData3.png)
55+
56+
- On Windows: .venv\Scripts\activate
57+
58+
This image shows the creation and activation of a Python virtual environment using python3 -m venv .venv and source .venv/bin/activate, preparing an isolated workspace for the project.
59+
60+
61+
62+
4. Install Required Packages
63+
64+
- pip install -r requirements.txt
65+
66+
![Step 4 – Install Required Packages](./Photos/DumbyData4.png)
67+
68+
This image shows the installation of required Python packages using pip install -r requirements.txt, ensuring all dependencies for the project are set up in the virtual environment.
69+
70+
71+
5. Run the Generator
72+
73+
- python main.py
74+
75+
![Step 5 – Run the Generator](./Photos/DumbyData5.png)
76+
77+
The generator will launch a console UI that prompts you to choose:
78+
79+
- Output directory
80+
81+
- Number of files
82+
83+
- Sensitivity level
84+
85+
- File types to generate
86+
87+
This image shows the execution of python main.py, which launches the Redback Dummy Data Generator’s console interface, prompting the user to specify a directory to save the generated synthetic test files.
88+
89+
---
90+
91+
92+
## Output
93+
94+
The generated synthetic test files (e.g. .csv, .json, .txt, .pdf, .docx) will be saved in the directory you specified. These are designed to reflect realistic structures and sensitivity distributions.
95+
96+
- Notes
97+
98+
Activate your virtual environment each time before running the generator (source .venv/bin/activate)
99+
100+
You can extend or modify the generation logic by editing main.py or extending the DummyDataGenerator class
101+
102+
If you add new packages, don’t forget to update requirements.txt
103+
104+
For troubleshooting, enhancements, or support, contact the Redback Ethics team or open an issue in the GitHub repository.
105+
280 KB
Loading
205 KB
Loading
92.8 KB
Loading
421 KB
Loading
201 KB
Loading
Lines changed: 99 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,99 @@
1+
---
2+
sidebar_position: 1
3+
---
4+
# Project Overview
5+
6+
## Asset Assessment
7+
8+
- **Project Name:** Redback Asset Assessment
9+
- **Purpose:**
10+
Introduce stakeholders and new developers to the Redback Asset Assessment, its goals, scope, the problem it solves, and its classification system for sensitive data.
11+
12+
---
13+
14+
## Problem Statement
15+
16+
Before detailing the goals and structure of this project, it’s essential to define the core issue that the Redback Asset Assessment is designed to address:
17+
18+
> Sensitive data breaches remain one of the most common and damaging threats to organizations.
19+
20+
Such breaches can result in:
21+
- Identity theft,
22+
- Customer harm,
23+
- Legal and regulatory penalties,
24+
- Loss of trust and reputation.
25+
26+
Common causes include:
27+
- Data stored without proper classification,
28+
- Information retained beyond legal timeframes,
29+
- Exposure of data during development or system integration,
30+
- Lack of encryption or access control.
31+
32+
---
33+
34+
## Project Goals
35+
36+
The **Redback Asset Assessment** is designed to proactively combat these issues by automating the **classification** and **flagging** of sensitive data. This enables guided responses and automated actions, ensuring compliance with modern privacy standards.
37+
38+
This project aims to help Redback:
39+
- Detect exposure risks early in the development lifecycle.
40+
- Classify sensitive data by urgency, legal impact, and business sensitivity.
41+
- Comply with key data privacy standards (e.g., **APP 11**, **Privacy Act 1988**).
42+
- Automate DevOps-driven mitigation workflows for compliance enforcement.
43+
44+
---
45+
46+
## Scope
47+
48+
The tool scans:
49+
- **Code repositories**
50+
- **Documents**
51+
- **Databases**
52+
53+
It locates **text** and **file-based sensitive data**, classifying it by:
54+
- **Data Type:** PII, PHI, NPI, etc.
55+
- **Storage Format:** JSON, TXT, MP4, etc.
56+
- **Lifecycle Status:** Retained vs. Expired
57+
- **Risk Level:** Low, Medium, High
58+
59+
**Integration targets** include CI/CD pipelines, file systems, and enterprise systems, providing early detection and containment of privacy risks.
60+
61+
---
62+
63+
## Key Features
64+
65+
- **Data Classification:** Supports types like PII, PHI, NPI, biometric, and more.
66+
- **Risk Levels:** Flags data by sensitivity level (Low/Medium/High) and recommends controls.
67+
- **DevOps Integration:** CI/CD pipelines, developer tools, SIEMs, etc.
68+
- **Compliance Monitoring:** Detects expired, exposed, or misclassified data.
69+
70+
---
71+
72+
## Target Users
73+
74+
| Role | Use Case |
75+
|-------------------|--------------------------------------------------|
76+
| Development Teams | Prevent data leaks in code and builds |
77+
| Security Analysts | Proactively identify data breach risks |
78+
| Compliance Officers | Validate regulatory compliance and flag issues |
79+
80+
---
81+
82+
## Example Use Cases
83+
84+
- Preventing sensitive data from being pushed to public repositories.
85+
- Detecting unencrypted medical or financial records.
86+
- Automatically deleting records beyond their retention period.
87+
- Alerting when real production data is used in test environments.
88+
89+
---
90+
91+
## Summary
92+
93+
The **Redback Asset Assessment** revolutionizes data protection by making data sensitivity detection:
94+
- **Automatic**
95+
- **Proactive**
96+
- **Enforceable**
97+
98+
It is designed for **seamless integration** with existing company workflows to reduce data breach risks and ensure compliance as the company scales and evolves.
99+
Lines changed: 8 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,8 @@
1+
{
2+
"label": "Asset Assessment Project",
3+
"position": 2,
4+
"link": {
5+
"type": "generated-index",
6+
"description": "Documents relating to the Asset Assessment Project."
7+
}
8+
}
Lines changed: 86 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,86 @@
1+
---
2+
sidebar_position: 1
3+
---
4+
# Project Overview
5+
6+
## Cross-Team Legal Advice
7+
8+
## Purpose
9+
10+
Inform Redback Operation team members from all projects about the legal requirements related to the work they are undertaking, as well as provide unofficial legal advice regarding whether or not they are acting in line with said requirements.
11+
12+
---
13+
14+
## Problem Statement
15+
16+
A lack of awareness of the relevant legal requirements by members of Redback Operations results in a greater risk of data being mishandled and misconduct within the team's work.
17+
18+
This lack of awareness could result in:
19+
20+
- Breaches of Privacy laws
21+
- Breaches of user’s rights
22+
- Increased risk of negligence
23+
- Extreme damage to reputation
24+
25+
Common causes include:
26+
27+
- Lack of legal knowledge
28+
- General lack of law background
29+
- Lack of real-world experience
30+
31+
---
32+
33+
## Project Goals
34+
35+
The Cross-Team Legal Advice project is designed to:
36+
37+
- Educate members of Redback Operations
38+
- Provide unofficial legal advice to teams on their compliance with relevant legal requirements
39+
- Inform members about legal obligations and how to be more compliant
40+
41+
The project aims to help Redback:
42+
43+
- Comply with relevant legal requirements, including but not limited to:
44+
- The *Privacy Act 1988 (Cth)*
45+
- The *Australian Consumer Law* (Schedule 2 of the *Competition and Consumer Act 2010 (Cth)*)
46+
- Ensure members are aware of certain legal requirements
47+
48+
---
49+
50+
## Scope
51+
52+
**Tools Used:**
53+
54+
- **Google Forms:** Multiple choice questions regarding legal issues and optional short answer fields for additional legal questions
55+
- **Google Sheets:** Accessed by Cross-Team Legal Advice members to log responses from the form
56+
- **Google Docs:** Used to store and manage the questions for the form
57+
- **FAQ Document:** (To be created in Semester 2) Will contain frequently asked questions and common legal issues, and will be continuously updated
58+
59+
---
60+
61+
## Key Features
62+
63+
- **Google Forms:** Used by Redback team members to seek legal advice
64+
- **Google Sheets:** Used by Cross-Team Legal Advice members to track form responses
65+
- **FAQ Document (Semester 2):** Lists frequent or relevant legal questions/issues and provides guidance; will be regularly updated
66+
67+
---
68+
69+
## Target Users
70+
71+
| Role | Use Case |
72+
|---------------------------|-----------------------------------------------------|
73+
| All Redback Operations team members | Seek legal advice regarding the work they are undertaking |
74+
75+
---
76+
77+
## Example Use Cases
78+
79+
- A member of another team wants to ensure compliance with the Privacy Act
80+
- A member of another team has a question about the Australian Consumer Law
81+
82+
---
83+
84+
## Summary
85+
86+
The Cross-Team Legal Advice project serves as both a compliance aid and an educational tool for the Redback Operations team. It is designed to improve legal awareness and reduce the risk of misconduct by ensuring that unofficial legal guidance is delivered effectively and efficiently across teams.

0 commit comments

Comments
 (0)