Skip to content

Commit 27fb739

Browse files
committed
updated README.md
1 parent 951eecd commit 27fb739

File tree

1 file changed

+35
-4
lines changed

1 file changed

+35
-4
lines changed

README.md

Lines changed: 35 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -1,9 +1,40 @@
1-
Welcome to your new Kafka Connect connector!
1+
# Kafka Connect Source GitHub
2+
3+
This connector allows you to get a stream of issues and pull requests from your GitHub repository, using the GitHub Api: https://developer.github.com/v3/issues/#list-issues-for-a-repository
4+
5+
Issues are pulled based on "updated_at" field, meaning any update to an issue or pull request will appear in the stream.
6+
7+
The connector writes to topic that is great candidate to demonstrate *log compaction*. It's also a fun way to automate your GitHub workflow.
8+
9+
It's finally aimed to be an educative example to demonstrate how to write a Source Connector a little less trivial than the `FileStreamSourceConnector` provided in Kafka.
10+
11+
# Contributing
12+
13+
This connector is not perfect and can be improved, please feel free to submit any PR you deem useful.
14+
15+
# Configuration
16+
```
17+
name=GitHubSourceConnectorDemo
18+
tasks.max=1
19+
connector.class=com.simplesteph.kafka.GitHubSourceConnector
20+
topic=github-issues
21+
github.owner=kubernetes
22+
github.repo=kubernetes
23+
since.timestamp=2017-01-01T00:00:00Z
24+
# I heavily recommend you set those two fields:
25+
auth.username=your_username
26+
auth.password=your_password
27+
```
228

329
# Running in development
430

531
```
6-
mvn clean package
7-
export CLASSPATH="$(find target/ -type f -name '*.jar'| grep '\-package' | tr '\n' ':')"
8-
connect-standalone config/worker.properties config/GitHubSourceConnectorExample.properties
32+
./build.sh
33+
./run.sh
934
```
35+
36+
I plan on creating a Dockerfile to simplify running this connector in standalone mode.
37+
38+
# Deploying
39+
40+
TODO

0 commit comments

Comments
 (0)