---
type: tool
tags: pkdb promnesia HPI dev
---
# Promensia & HPI

- [x] Remote ssh-tunnel to a promnesia.sqlite VM with [[user-systemd]] listening port to spawn [[ssh]] (see #systemd-user)
  DONE:
  - reported @ SO [for `systemctl --user`](https://unix.stackexchange.com/questions/383678/on-demand-ssh-socks-proxy-through-systemd-user-units-with-socket-activation-does)
- [x] [promnesia-PR#211 for partial updates](https://github.com/karlicoss/promnesia/pull/211):
  CLI to update DB (fix [karlicoss/promnesia#20](https://github.com/karlicoss/promnesia/issues/20) for real time indexing)
- [ ] PR: Logging INFO by default & configure logging by-file
- [ ] automate extraction & indexing with cron jobs
- [ ] Integrate [Polar Bookshelf](https://github.com/burtonator/) by downloading everything in promnesia DB!
- [ ] HPI/promnesia extractors PRs:
  - [ ] [promnesia-PR#204 for Viber source](https://github.com/karlicoss/promnesia/pull/204):
    - [x] finalize [promnesia-PR#208](https://github.com/karlicoss/promnesia/pull/208)
    - [ ]  spread into HPI: But _telegram_ source is also promnesia-only!?
  - [x] HPI/promnesia PR: Signal extractor:
    - export code taken from [`carderne/signal-export`](https://github.com/carderne/signal-export)
    - [Allow exporting a backup from Signal Desktop](https://github.com/signalapp/Signal-Desktop/issues/522),
      [Support creating an archive of messages and media (#1013)](https://github.com/signalapp/Signal-Desktop/issues/1013) and
      [Error: Encrypted export/import is disabled (#2516)](https://github.com/signalapp/Signal-Desktop/issues/2516)
    - [ ] fix signal when `http_only``
  - [ ] HPI/promnesia PR: Disqus extractor
    - Requested GDPR disqus-archive:
      - Archive came back quasi-empty!  Reported, and awaiting reply.
      - [support issue](https://privacyportal.onetrust.com/ui/#/requests/details/ec5d415b-e5be-4615-b4bc-e887831b00e9)
      - [notification email](https://mail.google.com/mail/u/0/#inbox/FMfcgxwLsdKmRLGdNPBlVdzGdHGTSflb)
  - [ ] Amazon extractor (e.g. books whish-list)
  - [ ] Zulip extractor
  - [ ] Wikipedia extractor
  - [ ] [GitHub GDPR source?](https://github.com/karlicoss/promnesia/issues/74#)
- [ ] harvest from `stexport`: [OAuth](https://stackapps.com/apps/oauth/view/19769) fail!
  - [x] Throttle-limited for 24hours(!), reported in [karlicoss/stexport#1](https://github.com/karlicoss/stexport/issues/1), fixed.
- [ ] harvest [Chrome & Firefox history](https://github.com/karlicoss/promnesia/blob/master/src/promnesia/sources/browser.py)
- [ ] Promnesia-PR to document all the above (see also [karlicoss/promnesia#15](https://github.com/karlicoss/promnesia/issues/15))
- [ ] HPI-BUGs: x2 bugs to HPI & pockexport [[pkdb]] tools
- [ ] HPI-PR: fill-in missing URLs from retweets in Twitter-archive (proposed in [karlicoss/promnesia#193](https://github.com/karlicoss/promnesia/issues/193)),
  based on [twitter-entities understanding](https://developer.twitter.com/en/docs/twitter-api/v1/data-dictionary/object-model/entities#retweets-quotes)
  (originally filed [karlicoss/promnesia#193](https://github.com/karlicoss/promnesia/issues/193))
- [ ] Use desktop pop-up notifications scheme to link from collected promnesia visits.

[//begin]: # "Autogenerated link references for markdown compatibility"
[pkdb]: pkdb.md "Personal Knowledge Database"
[//end]: # "Autogenerated link references"