Skip to content

Commit

Permalink
Merge pull request #8 from claromes/v0.3
Browse files Browse the repository at this point in the history
v0.3
  • Loading branch information
claromes authored Nov 14, 2023
2 parents 32af74e + 3412545 commit 2ae7f69
Show file tree
Hide file tree
Showing 8 changed files with 232 additions and 184 deletions.
2 changes: 1 addition & 1 deletion .gitignore
Original file line number Diff line number Diff line change
@@ -1 +1 @@
venv/
.venv/
5 changes: 4 additions & 1 deletion .streamlit/config.toml
Original file line number Diff line number Diff line change
@@ -1,7 +1,10 @@
[theme]
base="light"
primaryColor="#ab2e33"
backgroundColor="#e7e7e7"
secondaryBackgroundColor="#efefef"
textColor="#000000"
backgroundColor="#f9f9f9"
font="serif"

[client]
displayEnabled=true
Expand Down
68 changes: 26 additions & 42 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,25 +1,32 @@
> [!IMPORTANT]
> If the application is down, please check the [Streamlit Cloud Status](https://www.streamlitstatus.com/).
<br>

# 🏛️ Wayback Tweets

[![Streamlit App](https://static.streamlit.io/badges/streamlit_badge_red.svg)](https://waybacktweets.streamlit.app) [![GitHub release (latest by date including pre-releases)](https://img.shields.io/github/v/release/claromes/waybacktweets?include_prereleases)](https://github.com/claromes/waybacktweets/releases) [![License](https://img.shields.io/github/license/claromes/waybacktweets)](https://github.com/claromes/waybacktweets/blob/main/LICENSE.md)
[![Streamlit App](https://static.streamlit.io/badges/streamlit_badge_black_white.svg)](https://waybacktweets.streamlit.app) [![GitHub release (latest by date including pre-releases)](https://img.shields.io/github/v/release/claromes/waybacktweets?include_prereleases)](https://github.com/claromes/waybacktweets/releases) [![License](https://img.shields.io/github/license/claromes/waybacktweets)](https://github.com/claromes/waybacktweets/blob/main/LICENSE.md)


Tool that displays multiple archived tweets on Wayback Machine to avoid opening each link manually. Via [Wayback CDX Server API](https://github.com/internetarchive/wayback/tree/master/wayback-cdx-server).
Tool that displays, via [Wayback CDX Server API](https://github.com/internetarchive/wayback/tree/master/wayback-cdx-server), multiple archived tweets on Wayback Machine to avoid opening each link manually. The app is a prototype written in Python with Streamlit and hosted at Streamlit Cloud.

<p align="center">
<img src="assets/wbt-0.2.gif" width="500">
</p>
Users can define the number of tweets displayed per page and apply filters based on specific years. There is also an option to filter and view only deleted tweets.

*Thanks Tristan Lee for the idea.*

## Features
## Community

>"Original way to find deleted tweets." — [Henk Van Ess](https://twitter.com/henkvaness/status/1693298101765701676)
>"This is an excellent tool to use now that most Twitter API-based tools have gone down with changes to the pricing structure over at X." — [The OSINT Newsletter - Issue #22](https://osintnewsletter.com/p/22#%C2%A7osint-community)
>"One of the keys to using the Wayback Machine effectively is knowing what it can and can’t archive. It can, and has, archived many, many Twitter accounts... Utilize fun tools such as Wayback Tweets to do so more effectively." — [Ari Ben Am](https://memeticwarfareweekly.substack.com/p/mww-paradise-by-the-telegram-dashboard)
>"Want to see archived tweets on Wayback Machine in bulk? You can use Wayback Tweets." — [Daily OSINT](https://twitter.com/DailyOsint/status/1695065018662855102)
- 30 tweets per page
- Filtering by only deleted tweets
>"Untuk mempermudah penelusuran arsip, gunakan Wayback Tweets." — [GIJN Indonesia](https://twitter.com/gijnIndonesia/status/1685912219408805888)
>"A tool to quickly view tweets saved on archive.org." — [Irina_Tech_Tips Newsletter #3](https://irinatechtips.substack.com/p/irina_tech_tips-newsletter-3-2023#%C2%A7wayback-tweets)
## Docs

- [Roadmap](docs/ROADMAP.md)
- [Changelog](docs/CHANGELOG.md)

## Development

Expand All @@ -39,32 +46,9 @@ $ `streamlit run app.py`

Streamlit will be served at http://localhost:8501

## Bugs

- [ ] "web.archive.org took too long to respond."
- [x] `only_deleted` checkbox selected for handles without deleted tweets
- [x] Pagination: set session variable on first click
- [x] Pagination: scroll to top
- [x] `IndexError`
- [ ] Timeout error

## Roadmap

- [x] Pagination
- [x] Footer
- [x] Disabled/ Empty
- [x] Feedbacks
- [ ] Download dataset
- [x] Review data cache
- [x] Changelog
- [ ] Prevent duplicate URLs
- [ ] Range size defined by user
- [ ] `parse_links` exception
- [ ] Add current page to page title
- [ ] Parse MIME type `warc/revisit`
- [ ] Parse MIME type `text/plain`
- [ ] Filter by period/datetime
- [ ] Apply filters by API endpoints
- [ ] Add contributing guidelines

## [Changelog](/CHANGELOG.md)
## Contributing

PRs are welcome. Check the roadmap or add a new feature.

> [!NOTE]
> If the application is down, please check the [Streamlit Cloud Status](https://www.streamlitstatus.com/).
Loading

0 comments on commit 2ae7f69

Please sign in to comment.