Got a working twint_json parser #1

Merged
danzbyrd merged 1 commit from twint_json_parser into dev 2022-10-12 02:07:54 +00:00
danzbyrd commented 2022-10-12 01:10:46 +00:00 (Migrated from github.com)

Summary

Related issues

Changes these areas

  • Bugfixes
  • Feature behavior
    • Created a new parser to work with custom jsonl output from twint. This was mainly done to be able to read the timestamp of a tweet.
    • updated UI to display the bookmarked time
<!-- IMPORTANT: Do not submit PRs with only formatting / PEP8 / line length changes. --> # Summary <!--e.g. This PR fixes ABC or adds the ability to do XYZ...--> # Related issues <!-- e.g. #123 or Roadmap goal # https://github.com/pirate/ArchiveBox/wiki/Roadmap --> # Changes these areas - [x] Bugfixes - [X] Feature behavior - - Created a new parser to work with custom jsonl output from twint. This was mainly done to be able to read the timestamp of a tweet. - - updated UI to display the bookmarked time
radicalized (Migrated from github.com) approved these changes 2022-10-12 01:12:35 +00:00
radicalized (Migrated from github.com) left a comment

Looks good!

Looks good!
@ -31,7 +34,7 @@ def parse_twint_json_export(json_file: IO[str], **_kwargs) -> Iterable[Link]:
ts_str = str(datetime.now(timezone.utc).timestamp())
if data.get('timestamp'):
# chrome/ff histories use a very precise timestamp
radicalized (Migrated from github.com) commented 2022-10-12 01:12:25 +00:00
        #print(data)

I think this was left here from debugging / dev?

```suggestion #print(data) ``` I think this was left here from debugging / dev?
Sign in to join this conversation.
No Reviewers
No Milestone
No project
No Assignees
repo.issues.num_participants_one%!(EXTRA int=1)
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference
BallsGang/ArchiveByrd!1
No description provided.