A Webapp that receives tweets as input and identifies if a similar tweet has been flagged as False or True.
Python
0
21 commits
updated Nov 22, 2020
Checking misinformation service
A Webapp that receives tweets as input and identifies if a similar tweet has been flagged as False or True.
We generate embeddings of all the previously flagged Tweets/Text data and create an Approximate nearest neighbor Index that we can use to retrieve similar embeddings, given an input embedding.
From the nearest neighbors, we can get similar tweets and we compare our input tweet with similar tweets using a model similar to the zero-shot classification model. The model tells us if the inputs contradict or not. If they do not and we have a high score, we can assume that the inputs are similar and can assign the same label to the query tweet. The label corresponding to the tweet combination with the highest score is returned.

Python 3.7.6
python -m virtualenv env
Enter the virtual environment.
source env/bin/activate
pip install -r requirements.txt
To run the service just run the command:
python app.py
To re index new Tweets/Texts add them in the Inputs folder and run:
python train.py
A Webapp that receives tweets as input and identifies if a similar tweet has been flagged as False or True.
Python
0
21 commits
updated Nov 22, 2020
Checking misinformation service
A Webapp that receives tweets as input and identifies if a similar tweet has been flagged as False or True.
We generate embeddings of all the previously flagged Tweets/Text data and create an Approximate nearest neighbor Index that we can use to retrieve similar embeddings, given an input embedding.
From the nearest neighbors, we can get similar tweets and we compare our input tweet with similar tweets using a model similar to the zero-shot classification model. The model tells us if the inputs contradict or not. If they do not and we have a high score, we can assume that the inputs are similar and can assign the same label to the query tweet. The label corresponding to the tweet combination with the highest score is returned.

Python 3.7.6
python -m virtualenv env
Enter the virtual environment.
source env/bin/activate
pip install -r requirements.txt
To run the service just run the command:
python app.py
To re index new Tweets/Texts add them in the Inputs folder and run:
python train.py