sch/Slixfeed
sch/Slixfeed
3
1
Fork 1
Code Issues 15 Pull requests Projects Releases Packages Wiki Activity Actions
359 commits 1 branch 0 tags 4.2 MiB
Commit graph

268 commits

Author SHA1 Message Date
Schimon Jehudah
5135186717 Add support for tags 2024-02-25 19:21:10 +00:00
Schimon Jehudah
afeaa8707b Add more permissions to ad-hoc commands from MUC (see Prosody mod_muc_adhoc_bots) 
Handle more errors.
Add ad-hoc command Profile.
Support Python 3.10 (tomli).
Add table for scraping HTML (WIP).
Minor fixes.
 2024-02-25 01:52:24 +00:00
Schimon Jehudah
56f85fdf26 Add command version. 
Invite to groupchat upon command support.
 2024-02-23 14:54:54 +00:00
Schimon Jehudah
7d45a3249a Add ability to set number of immediate sent updates 2024-02-23 14:25:56 +00:00
Schimon Jehudah
e2652760bc Fix component mode 2024-02-23 13:51:19 +00:00
Schimon Jehudah
e13807442e Do not accept messages from self JID 2024-02-23 12:53:14 +00:00
Schimon Jehudah
bb9a1926f6 Add XEP-0356, XEP-0297 and XEP-0203 2024-02-23 09:00:39 +00:00
Schimon Jehudah
9bb37bc932 Add functionality to download article via ad-hoc. 
Add helper for URL.
 2024-02-23 02:55:31 +00:00
Schimon Jehudah
6e2a7305c2 Fix keys by setting lower case. 
Consolidate commands into options.
Various of fixes and improvements.
 2024-02-22 14:09:13 +00:00
Schimon Jehudah
74192965d1 Add missing file feeds.toml. 
Attempting to improve form Subscribers.
 2024-02-20 13:16:32 +00:00
Stephen Paul Weber
aedd52f145
Cleanup article render, show clickable link 2024-02-19 22:57:10 -05:00
Schimon Jehudah
32d765b482 Fix fetching items upon setting "old". 
Add form Browse
Add form Discover and Search (experimental)
Add form Remove
 2024-02-19 20:50:53 +00:00
Schimon Jehudah
88261571d1 Remove breakpoint 2024-02-19 00:42:59 +00:00
Schimon Jehudah
85f1ba18f0 Add functionality to set feed name (i.e. command rename). 
Improve forms.
 2024-02-19 00:26:10 +00:00
Schimon Jehudah
7b98d32d7f Fix keywords extracted from sqlite. 
Improve modiles fetch and crawl.
Add form featured feeds.
Add form roster manager.
Add form subscibers manager.
WIP
 2024-02-17 23:21:44 +00:00
Schimon Jehudah
c1dec9d808 Adjust modules client and component 2024-02-16 13:16:52 +00:00
Schimon Jehudah
9685b34536 Fix AttributeError: module 'slixfeed.sqlite' has no attribute 'get_filters_value' 2024-02-16 12:46:55 +00:00
Schimon Jehudah
bb44cd925c Fix error upon attempt to edit filter via form while another form is not set 2024-02-16 12:33:07 +00:00
Schimon Jehudah
10762a69e4 Fix check for filters and settings keys 2024-02-16 12:12:06 +00:00
Schimon Jehudah
288e5157fa Fix submission of filters 2024-02-16 02:59:01 +00:00
Schimon Jehudah
aa747985d9 Minor changes to command list items 2024-02-16 02:21:08 +00:00
Schimon Jehudah
8b6584fe6d Remove JID from title. 
Add a command instead.
Command to be removed.
 2024-02-16 02:14:23 +00:00
Schimon Jehudah
4e193a2b02 Add for Add Subscription. 
Segregating more code as one task per function, particularly adding of new subscription.
Fix allow/deny keys.
 2024-02-16 01:46:04 +00:00
Schimon Jehudah
6c0c571c1d Merge branch 'nicer-credits' into 'master' 
Nicer format for credits page

See merge request sjehuda/slixfeed!8
 2024-02-16 01:38:07 +00:00
Schimon Jehudah
21bfd3e3d5 Merge branch 'clear-next' into 'master' 
Clear session['next'] if we are done

See merge request sjehuda/slixfeed!7
 2024-02-16 01:34:09 +00:00
Schimon Jehudah
a4f870f26c Merge branch 'uri-type' into 'master' 
Add xs:anyURI type to import url field

See merge request sjehuda/slixfeed!9
 2024-02-16 01:32:15 +00:00
Stephen Paul Weber
2fa3173031
Remove var from fixed fields 
Since they don't need to get submitted back and are mostly just titles.

May want to consider https://xmpp.org/extensions/xep-0141.html in the future
 2024-02-15 00:16:03 -05:00
Stephen Paul Weber
f299876e5a
Add xs:anyURI type to import url field 
Allows using eg the URL keyboard layout on touch screen
 2024-02-15 00:09:26 -05:00
Stephen Paul Weber
b47a9cd938
Nicer format for credits page 2024-02-15 00:04:35 -05:00
Stephen Paul Weber
93ae763db7
Clear session['next'] if we are done 
It will currently contain whatever it was last set to since the session
value is persistent across steps, but the way to signal to slixmpp that
we are done and it should send status=completed is to have next set to
None, per https://codeberg.org/poezio/slixmpp/src/branch/master/slixmpp/plugins/xep_0050/adhoc.py#L317
 2024-02-14 23:20:51 -05:00
Schimon Jehudah
e8d5f082d0 Add export/import forms. 
Improve Subscriptions form (non functional yet).
 2024-02-15 00:16:51 +00:00
Schimon Jehudah
c8cd5e1b09 Improve groupchat functions to handle with erroneous cases 2024-02-14 17:09:54 +00:00
Schimon Jehudah
5c2ee8d51c Merge branch 'range-example' into 'master' 
Set datatype and range for settings fields

See merge request sjehuda/slixfeed!6
 2024-02-14 16:15:52 +00:00
Schimon Jehudah
7d243a4186 Merge branch 'fix-caps-more' into 'master' 
Send presence from full JID, not bare JID

See merge request sjehuda/slixfeed!5
 2024-02-14 09:10:24 +00:00
Stephen Paul Weber
fe19319066
Set datatype and range for settings fields 
This allows the client to know that the values are all integers within
some range.  Note that the min/max settings aren't working quite right
per https://codeberg.org/poezio/slixmpp/issues/3512
 2024-02-14 00:21:52 -05:00
Stephen Paul Weber
ef5c9ac2be
Send presence from full JID, not bare JID 
It will end up from full jid anyway and this fixes the cache lookup of
the caps hash so it uses the right one.
 2024-02-13 22:08:50 -05:00
Schimon Jehudah
dba7eefb96 Add About, Bookmarks and Manual forms 2024-02-14 03:04:49 +00:00
Schimon Jehudah
12689b8ef1 Merge branch 'error-note' into 'master' 
Use note of type=error to signal an error

See merge request sjehuda/slixfeed!4
 2024-02-13 21:07:57 +00:00
Stephen Paul Weber
d410ef8ab3
Use note of type=error to signal an error 2024-02-13 15:26:05 -05:00
Stephen Paul Weber
d7c213fe59
Fix caps by setting up all items before presence 
Note that update_caps also sends presence by default, when broadcast=True
 2024-02-13 15:06:11 -05:00
Schimon Jehudah
d3af15d623 Fix commands info and help to ignore case. 
Fix command read to handle lack of URL.
Add bookmark properties.
Add new experimental forms.
Thank you mirux.
 2024-02-13 19:34:37 +00:00
Schimon Jehudah
93a65f14d8 Add ad-hoc commands for filters 2024-02-12 21:01:48 +00:00
Schimon Jehudah
89ef18d5d7 Fix Ad-hoc form of Settings 2024-02-12 19:01:28 +00:00
Schimon Jehudah
e0864cc84e Accept only numerical value for key interval 2024-02-12 09:53:49 +00:00
Schimon Jehudah
f6bc76fdf8 Fix settings update. 
Add option to restore default settings.
Reorganize code.
Thank you mirux.
 2024-02-11 21:31:31 +00:00
Schimon Jehudah
065311d0d8 Add switch for media 2024-02-10 23:25:05 +00:00
Schimon Jehudah
1e794b3498 Do not cancel task immediately after it is allocated. 
Thank you chunk, A_Dragon, TML and graingert.
 2024-02-10 21:50:37 +00:00
Schimon Jehudah
9434833449 WIP: Closer to fix double message. See task.py 2024-02-10 17:53:53 +00:00
Schimon Jehudah
c568145ecf Fix bad reference to function that does not exist and - hopefully - improve subscription handling 2024-02-07 23:41:02 +00:00
Schimon Jehudah
6c16fa4af1 Restore support for disabling and enabling feeds. 
Assign handlers to "self".
Towards better handling of subscription and unsubscription.
Minor fixes.
 2024-02-07 22:24:59 +00:00
Schimon Jehudah
51e48c8389 Standardize modules client and component 2024-02-07 01:12:51 +00:00
Schimon Jehudah
00a8ed180a Fix presence and subscription handling. 
Segregate and atomize into classes.
 2024-02-07 00:26:42 +00:00
Schimon Jehudah
422e0669f1 Add ad-hoc commands 2024-02-06 03:04:43 +00:00
Schimon Jehudah
56aaccce68 Remove more unused functions 2024-02-04 19:22:51 +00:00
Schimon Jehudah
c9424ffd85 Remove function that does not exist yet 2024-02-04 19:16:23 +00:00
Schimon Jehudah
e36816756c Print version at startup 2024-02-04 18:56:19 +00:00
Schimon Jehudah
acce4fafdc Add arguments -v and --version 2024-02-04 18:19:56 +00:00
Schimon Jehudah
c7fa2496a8 Fix many issues amidst change of table structure 2024-02-04 17:08:12 +00:00
Schimon Jehudah
f683e11c4a Update list pathnames 2024-01-31 10:55:35 +00:00
Schimon Jehudah
dc85f73de5 Replace YAML by TOML 2024-01-28 11:17:31 +00:00
Schimon Jehudah
6883eb6615 Improve listing of commands 2024-01-27 19:21:45 +00:00
Schimon Jehudah
4da2a28184 Fix selection of image. 
Thank you roughnecks for the report.
 2024-01-27 19:19:41 +00:00
Schimon Jehudah
9094921b40 Enable usage of private chat on groupchat 2024-01-27 17:15:28 +00:00
Schimon Jehudah
4406e61fbe Improve update interval mechanism. 
Add service discovery identity.
Add exception errors.
 2024-01-26 11:34:07 +00:00
Schimon Jehudah
c1ef5acc7e More fixes 2024-01-24 20:28:14 +00:00
Schimon Jehudah
386b10ae15 Fix configuration and allow commenting unused keys 2024-01-24 19:41:40 +00:00
Schimon Jehudah
8dcff0b2fe Fix configuration 2024-01-24 18:59:10 +00:00
Schimon Jehudah
2f6b86522f Add service component support. 
Thank you to Mr. Guus der Kinderen from IgniteRealtime.org for promptly providing an Openfire instance for development.
 2024-01-24 18:11:39 +00:00
Schimon Jehudah
c9c552e33f Add support for ePUB and Text. 
Import OPML only from a moderator.
Fix error for sqlite.py module.
 2024-01-23 14:37:10 +00:00
Schimon Jehudah
13d87e2be7 Set directory cache 2024-01-22 15:27:01 +00:00
Schimon Jehudah
0d7f67d721 Fix handling of document error 2024-01-22 15:01:52 +00:00
Schimon Jehudah
4c64870d8f Fix handling of document error 2024-01-22 13:29:14 +00:00
Schimon Jehudah
ddca33fcf1 Update configuration files 2024-01-22 12:55:36 +00:00
Schimon Jehudah
c4ccdd1f9d Containerized configurations (step towards a portable software. SeeTPFC portablefreeware.com) 2024-01-22 12:48:00 +00:00
Schimon Jehudah
0512e14738 Add support for JSON Feed 2024-01-20 17:28:31 +00:00
Schimon Jehudah
4743ada0ca Remove pycache files 2024-01-18 21:04:02 +00:00
Schimon Jehudah
18c93083b7 Apply patch from grym 2024-01-18 20:57:49 +00:00
Schimon Jehudah
6a7d99f1a2 Add functionality profile 2024-01-17 14:36:28 +00:00
Schimon Jehudah
80e49a8d38 Fix archiving functionality 2024-01-14 21:43:23 +00:00
Schimon Jehudah
c04a1b6534 Fix statistics 2024-01-14 18:05:12 +00:00
Schimon Jehudah
219c23a648 Restore settings functionality. 
Minor fixes for image extraction and self groupchat message.
 2024-01-14 12:46:38 +00:00
Schimon Jehudah
f721059278 Remove magnet link check 2024-01-13 17:27:18 +00:00
Schimon Jehudah
43fa1a463c Save enclosures 
Send new message upon media detection
 2024-01-13 17:17:43 +00:00
Schimon Jehudah
ec82aeb3cc Detect image from xml enclosure in addition to html img 2024-01-11 10:55:42 +00:00
Schimon Jehudah
b675618b95 Change order of html data and status code 2024-01-10 21:40:12 +00:00
Schimon Jehudah
b1cb9f7777 Handle readability exception 2024-01-10 21:20:02 +00:00
Schimon Jehudah
0ca37dfdee Improve SQLite performance. 
Handle missing packages errors.
 2024-01-10 20:06:56 +00:00
Schimon Jehudah
46a0819229 Add functionality to display images from first link to provide an image (experimental) 2024-01-09 22:36:16 +00:00
Schimon Jehudah
8b313acd91 Include entry Id in formed message 2024-01-09 16:00:01 +00:00
Schimon Jehudah
b06e1bc693 Add functionality to download articles 2024-01-09 15:53:19 +00:00
Schimon Jehudah
9709c052ee Improve code of module crawl.py 2024-01-09 12:34:10 +00:00
Schimon Jehudah
956ce69fcb Fix entry duplication check 2024-01-07 09:57:54 +00:00
Schimon Jehudah
fa4c85cd61 Comment breakpoint() 2024-01-06 22:17:04 +00:00
Schimon Jehudah
dbe9ec3073 Restructure modules and database. 
Add OPML import functionality.
Minor improvements.
 2024-01-06 22:03:08 +00:00
Schimon Jehudah
6b07640666 Fix updates retrieval 2024-01-04 13:58:06 +00:00
Schimon Jehudah
b77ef5346f More segregation of code 2024-01-04 12:38:22 +00:00
Schimon Jehudah
7135994888 Segregate code into more particular functions 2024-01-04 01:16:24 +00:00
Schimon Jehudah
96f3369539 Fix a couple of errors and split functions 2024-01-03 15:04:01 +00:00
Schimon Jehudah
94af40cf40 Fix creation of directory logs/ thanks roughnecks 2024-01-03 12:30:52 +00:00
Schimon Jehudah
9386e5de49 Add functionality to export to markdown 2024-01-03 12:17:39 +00:00
Schimon Jehudah
a3d68f6a8f Add functionality to export feeds to OPML 2024-01-03 10:37:33 +00:00
Schimon Jehudah
9843337e43 Fix missing key error 2024-01-02 18:45:43 +00:00
Schimon Jehudah
de200b3b03 Split more functions into smaller functions 2024-01-02 18:11:36 +00:00
Schimon Jehudah
e2ad10592d Fix command recent 2024-01-02 13:19:27 +00:00
Schimon Jehudah
42cf0afeff Fix respond error 2024-01-02 12:58:45 +00:00
Schimon Jehudah
d25c17a84a Fix error 2024-01-02 12:52:37 +00:00
Schimon Jehudah
57b666dde2 Remove breakpoint 2024-01-02 12:44:32 +00:00
Schimon Jehudah
2026dc9a6a Set initial value to variable response 2024-01-02 12:29:48 +00:00
Schimon Jehudah
0eaeaaa757 Fix error 2024-01-02 12:21:28 +00:00
Schimon Jehudah
8b1e03d8e9 Restrict command breakpoint 2024-01-02 12:17:48 +00:00
Schimon Jehudah
4701602355 Restrict command bookmarks 2024-01-02 12:12:29 +00:00
Schimon Jehudah
beb5c4c976 Fix interval status message 2024-01-02 12:06:35 +00:00
Schimon Jehudah
b4a20e9808 Fix command bookmarks 2024-01-02 11:52:04 +00:00
Schimon Jehudah
f65be8b5c8 WIP 
Add http proxy support.
Add more functionality to handle bookmarks.
Split into more modules.
Remove callback function initdb.
Tasked status messages are broken.
 2024-01-02 11:42:41 +00:00
Schimon Jehudah
8e3e06b36b Improve redirection mechanism 2023-12-29 01:35:20 +00:00
Schimon Jehudah
76b2713223 Add proxy for links. 
Fix minor problems.
 2023-12-29 00:45:01 +00:00
Schimon Jehudah
395c2373ae Fix error ModuleNotFoundError. Thank you roughnecks for the second time this evening! 2023-12-28 18:16:33 +00:00
Schimon Jehudah
7ee4000ee0 Laura: Fix awaitable error 4d03d6e16e 2023-12-28 17:58:49 +00:00
Schimon Jehudah
b2387a700d Fix error ModuleNotFoundError. Thank you roughnecks 2023-12-28 16:30:32 +00:00
Schimon Jehudah
08001eebf8 Add __init__.py and split muc.py into bookmark.py 2023-12-28 16:22:32 +00:00
Schimon Jehudah
61bd792572 Add slixfeed.py for command line and split xmpp into modules. 2023-12-28 14:50:23 +00:00
Schimon Jehudah
8fbe97e357 Add ClearURLs functionality. 
Fix Proxy functionality (remove www).
 2023-12-27 22:48:31 +00:00
Schimon Jehudah
4d03d6e16e Laura: Fix runtime warning: coroutine was never awaited 
```
/usr/lib/python3.11/asyncio/events.py:73: RuntimeWarning: coroutine 'send_update' was never awaited
  self._args = None
RuntimeWarning: Enable tracemalloc to get the object allocation traceback
/usr/lib/python3.11/asyncio/events.py:73: RuntimeWarning: coroutine 'send_status' was never awaited
  self._args = None
RuntimeWarning: Enable tracemalloc to get the object allocation traceback
```
Thank you, Laura
 2023-12-27 22:41:53 +00:00
Schimon Jehudah
57f429fff0 Add proxy services. 
Merry Christmas to one and all!
 2023-12-26 11:22:45 +00:00
Schimon Jehudah
56d0da9a76 Improve connectivity recovery 2023-12-24 18:37:05 +00:00
Schimon Jehudah
ccd01b837d Fixed error: 
ERROR    Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f00643ef490>
 2023-12-18 16:09:33 +00:00
Schimon Jehudah
0c80c722bb Revert change 2023-12-18 15:58:33 +00:00
Schimon Jehudah
7d711a9f11 Fix error: 
ERROR    Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f00643ef490>
 2023-12-18 15:56:42 +00:00
Schimon Jehudah
19bc626eb1 Add user agent setting. Add command reset (mark as read). Fix error with command recent. Fix error with command stats. Thanks roughnecks for reporting these issues. 2023-12-18 15:29:32 +00:00
Schimon Jehudah
d4b0d08480 Do not send updates when updates are not enabled. Add a new module for handling URLs. Remove awaitables from functions of mere runtime actions. 2023-12-14 08:43:30 +00:00
Schimon Jehudah
d8a1799978 Add support for configuration files. Undo most of the changes of commit ecdcfe9c22 2023-12-11 09:04:45 +00:00
Schimon Jehudah
7c928fea25 Add option to limit archived entries 2023-12-08 11:32:01 +00:00
Schimon Jehudah
e734c57bc2 Fixed new compliance mechanism. Thank you for the report, roughnecks. 2023-12-05 09:07:45 +00:00
Schimon Jehudah
ba97c33695 Disable activation token and mastership mechanism 2023-12-05 08:18:29 +00:00
Schimon Jehudah
ecdcfe9c22 Fox issue with callback (adding URL) and an attempt to import specific parts of modules 2023-12-04 14:41:02 +00:00
Schimon Jehudah
75ccfbe521 Various of modifications 2023-12-01 13:22:03 +00:00
Schimon Jehudah
88e1468bd6 Format title - add feed title to entry title 2023-11-29 18:53:24 +00:00
Schimon Jehudah
6e7c57d745 Add option to ignore old news items 2023-11-29 15:32:35 +00:00
Schimon Jehudah
634b0e3ce6 Add MUC support including bookmarks and improve filtering 2023-11-27 17:22:56 +00:00
Schimon Jehudah
071bf78e1d Add support for groupchat and activation feature 2023-11-26 15:23:52 +00:00
Schimon Jehudah
31baf96430 Add preview commands (read and select) and experimenting with XEP-0249 2023-11-26 05:48:09 +00:00
Schimon Jehudah
efa05aaba1 Fix tasks. Listen carefully to Laura. 2023-11-23 16:55:36 +00:00
Schimon Jehudah
f82550d24c Add feeds, mionr improvements and notes 2023-11-22 11:47:34 +00:00
Schimon Jehudah
bbc25d25b9 Delete main.py 2023-11-15 14:02:39 +00:00
Schimon Jehudah
cb2317b35a Fix archiving. WARNING of complexity due to UNION of SQL 2023-11-15 14:00:49 +00:00
Schimon Jehudah
031eb6ce53 Update 8 files 
- /slixfeed/sqlitehandler.py
- /slixfeed/xmpphandler.py
- /slixfeed/opmlhandler.py
- /slixfeed/datahandler.py
- /slixfeed/datetimehandler.py
- /slixfeed/__main__.py
- /slixfeed/confighandler.py
- /slixfeed/filterhandler.py
 2023-11-13 13:45:10 +00:00
Schimon Jehudah
9d6a211d36 Delete feedhandler.py 2023-11-02 12:16:13 +00:00
Schimon Jehudah
01803de1a9 Delete settings.py 2023-11-02 12:15:49 +00:00
Schimon Jehudah
2d5485350e Merge branch 'master' into 'WIP' 
# Conflicts:
#   slixfeed/datahandler.py
#   slixfeed/xmpphandler.py
 2023-11-02 12:14:30 +00:00
Schimon Jehudah
af93a3781c Remove some print command and correct commented NOTE 2023-11-02 12:05:43 +00:00