Commit Graph

51 Commits

Author SHA1 Message Date
Lucas Verney a7ee94653f Revert "Reduce number of requests to housing websites"
This reverts commit 977e354646.
2021-04-28 19:54:27 +02:00
Lucas Verney 977e354646 Reduce number of requests to housing websites
Keep track of the last seen date and start crawling again from there for
the next crawl, instead of crawling everything at each invocation.

Can be configured through configuration options.
2021-04-12 23:28:42 +02:00
Lucas Verney 9b6407db05 WebOOB -> Woob 2021-04-08 20:08:23 +02:00
Lucas Verney 0d732aa3de Support 'OR' operations for description_should_contain 2021-03-26 23:36:36 +01:00
Gautier P 1bd855dbd8 Fix invalid black formatting 2021-02-08 17:08:52 +01:00
Gautier P 9f328259a7 Add INSEE filtering 2021-02-08 17:08:52 +01:00
Gautier P a92db5e8ee Reformat with black (max-line-length=120) 2021-02-08 17:08:52 +01:00
Gautier P 36e98bc5b3 Remove misleading log 2021-02-08 17:08:52 +01:00
Gautier P 713912cfbc Translate email notification 2021-02-08 17:08:52 +01:00
Gautier P 42909bd46f reformat with black 2021-02-08 17:08:52 +01:00
Gautier P 361725ea4d Add an option to ignore stations 2021-02-07 11:43:53 +01:00
Nicolas Frandeboeuf 5b15ce6918 Add keywords to ignore in description to avoid useless ads 2020-01-08 19:25:07 +01:00
Simon Sapin e4f1ce96bb Add support for SMTP authentication for email notification
CC 23bbee8271
2019-01-25 18:41:16 +01:00
Adrien Guatto a38cf0e9a8 Allow blacklisting words from flat descriptions
This commit adds a new field "description_should_not_contain" to the
configuration object. Any flat whose description contains a word
appearing in this list will be filtered out.
2018-11-07 15:53:13 +01:00
Lucas Verney e0e04317ca Support other transport modes, fix #62 2018-09-07 19:28:15 +02:00
VA 43b14ada51 config check: update since weboob now uses real Python enums 2018-06-24 21:04:35 +02:00
Lucas Verney bfc27bbb92 Update Flatisfy to handle the latest dev version of Weboob. Fixes #91 and #85. 2018-02-07 19:54:48 +01:00
Lucas Verney ee2880326c Add a way to download photos locally
Fix for #94.
2018-01-28 17:08:53 +01:00
Lucas Verney 08599d91de Address a few nits in review 2018-01-21 12:00:30 +01:00
Lucas Verney caa79f245b Fix CI, also do not fail if `~/.local` directory does not exist. 2018-01-18 14:16:38 +01:00
Lucas Verney 45c4eca775 Add a logging line after webserver is started.
Also remove useless `debug` config option.
2018-01-10 19:41:51 +01:00
Lucas Verney 83ff6be409 Better fix for #100 2017-12-30 19:30:32 +01:00
Lucas Verney 7196add731 Lint code 2017-12-30 14:45:58 +01:00
Lucas Verney 1119bdbf0b Allow to define the threshold between a housing and a station
Fix #101.
2017-12-29 22:58:05 +01:00
Lucas Verney c3941bd70c Rebuild data on import command if required 2017-12-06 19:16:24 +01:00
Lucas Verney 03d2ad6f7f Add CORS headers in the API response, add a debug option to get verbose debugging from Bottle webserver 2017-12-05 17:33:19 +01:00
Lucas Verney daf16d88ba Sphinx-generated doc 2017-12-05 14:56:08 +01:00
Lucas Verney 571b42f5b1 Check that postal codes are strings in config 2017-11-26 16:51:50 +01:00
Lucas Verney 4a65f52475 Do not store personal data by default, let user overload this behavior
through config.

Fixes #80.
2017-11-17 16:14:11 +01:00
Lucas Verney 40e62baadf Add a config option to filter on terms in the description. Fix #77. 2017-10-29 20:16:33 +01:00
Lucas Verney f81deb9f13 Rename minimum_photos config option to minimum_nb_photos 2017-10-29 20:15:19 +01:00
Lucas Verney 6b82af6b85 Review of Hatrix42 PR 2017-10-29 03:05:35 +01:00
Lucas Verney 9c55904f59 Merge branch 'master' of https://github.com/Hatrix42/Flatisfy into Hatrix42-master 2017-10-29 02:58:02 +01:00
Lucas Verney 1791142218 Check that area, rooms etc are lists in config 2017-10-29 02:39:15 +02:00
Maël Le Garrec$ e7c81d31ac Add config option for minimum number of pictures 2017-10-24 17:21:48 +02:00
Lucas Verney c96b2a3f4c Fix for https://github.com/Phyks/Flatisfy/issues/8 2017-10-19 15:34:02 -04:00
Lucas Verney f1a5535bca Fix an error introduced in 88a923c87e 2017-10-19 15:30:03 -04:00
Lucas Verney 88a923c87e Fix for https://github.com/Phyks/Flatisfy/issues/5 2017-09-24 22:51:12 +02:00
Benjamin Bouvier 23bbee8271 Adds basic email notifications when new flats have been found (fixes #47). 2017-07-06 15:06:13 +02:00
Lucas Verney f1df23dc29 Linting 2017-06-20 13:37:54 +02:00
Lucas Verney 6e12490fbd Add some doc about CLI option and better informative message 2017-06-19 17:20:53 +02:00
Lucas Verney ed7e9dfc1a Add a CLI argument to import only a given constraint. Drop the necessary constraint. 2017-06-19 16:08:06 +02:00
Lucas Verney bdf8a6b8d2 Handle multiple constraints in the config
All the backend part has been rewritten to handle multiple constraints
in the config (== multiple queries).

Also did some linting.

Still to be done: frontend part and doc.
2017-06-16 16:22:02 +02:00
Lucas Verney 82a88590b6 Rewrite data files management, to make it more modular
This is to prepare for the integration of Tcl data, see #58.
2017-06-15 15:48:16 +02:00
Lucas Verney f52b07b869 No need for unicode
Missed it while reviewing !2, but as we use `from builtins import str`, there is no need to use `unicode`.
2017-06-14 10:48:17 +02:00
Benjamin Bouvier 8c126ef8e3 Catch the right error when the constraint type name is not set; 2017-06-13 16:17:03 +02:00
Lucas Verney a5aeadef86
Various bug fixes
Fix some bugs introduced in recent developments as well as some UI
issues (and i18n).

Closes issue #42.
2017-05-04 20:52:10 +02:00
Lucas Verney 982ea995a7 Add a search feature and matching UI elements
Also do some minor UI improvements:
* Add an icon to identify followed flats in tables
* Fix wrong enforced plural for 'flats'
2017-05-03 15:55:08 +02:00
Lucas Verney 1d98c631e0 Refilter command and backends in config
* Add a refilter command
* Add a backend option in config to only enable some backends.
2017-05-03 15:55:07 +02:00
Lucas Verney a57d9ce8e3 Switch to a Vue-based web app
* Init Webpack / Babel / etc setup.
* Build the app using Vue, Vue-router, Vuex.
* i18n

Some backends changes were made to match the webapp development:
* Return the flat status as a single string ("new" rather than
"FlatStatus.new")

* Completely switch to calling Weboob API directly for fetching
* Use Canister for Bottle logging
* Handle merging of details dict better
* Add a WSGI script
* Keep track of duplicates
* Webserver had to be restarted to fetch external changes to the db
* Handle leboncoin module better

Also add contributions guidelines.

Closes issue #3
Closes issue #14.
2017-05-03 15:54:26 +02:00