Seeing the same content is annoying. 9 Gag and Reddit suffer from posts being re-uploaded constantly. Wouldn't it be great if we can remember what kind of pictures we have already seen and simply not show us the same stuff again?
Planned features
- Duplicate / Report Detection
- Offline Mode
- Jump to posts from specific date
9Gag publishes meta information https://9gag.com/v1/group-posts/group/default/type/SECTION_TITLE?NEXT_TOKEN as JSON
which can easily be parsed and point towards the raw image/video file to download the content.
Image duplicates will be detected by utilizing my perceptual image hash library
I have not made any attempts to target videos and gifs yet. As far as I am aware gif and video reposts usually upload the same content 1:1 therefore a naive approach like checking the file size and hashing the first keyframe might already be enough to check for reposts. If this is not enough maybe implement Perceptual video hashing based on the Achlioptas's random projections .
Pre-Alpha! This repository contains code pushed at the end of a day, containing multiple debug statements, half written classes and might not even compile without errors. Currently I am merging an older project into this repository. Since I am getting used to datafx and javafx the section is especially messy. Tinkering around a bit here and there.
I used some of the legacy code I am reusing in this project to pull some statistics from 9gag a while ago. Here are a few pretty pictures to look at while the code is coming along eventually.
