Commit Graph

28 Commits

Author SHA1 Message Date
Gautier P 4d11726332 Use ratelimit to avoid rate bans on some APIs 2021-02-08 18:23:36 +01:00
Gautier P 1bd855dbd8 Fix invalid black formatting 2021-02-08 17:08:52 +01:00
Gautier P a92db5e8ee Reformat with black (max-line-length=120) 2021-02-08 17:08:52 +01:00
Gautier P 42909bd46f reformat with black 2021-02-08 17:08:52 +01:00
Gautier P caa4961679 Set housing.id only after retrieving phone if needed 2021-02-07 11:43:54 +01:00
Gautier P 395a8ba72b Crop to max_entries at most 2021-02-07 11:43:53 +01:00
Lucas Verney 826989f77c Monkey patch a WebOOB bug: No long waiting for the flats to be fetched!
When passing a `Query` to a WebOOB backend and the query has no cities
for this backend, WebOOB was returning nonsense. This is now solved as
we only call the relevant backends for each query.
2018-07-25 09:20:48 +02:00
Lucas Verney cc9ed3d34b Improve doc + s/weboob/WebOOB/ 2018-07-25 08:57:31 +02:00
Lucas Verney bfc27bbb92 Update Flatisfy to handle the latest dev version of Weboob. Fixes #91 and #85. 2018-02-07 19:54:48 +01:00
Lucas Verney 219b8e156e Fix a bug when throwing an exception with unicode characters from
Weboob.

As reported by @nicofrand.
2018-01-06 10:53:35 +01:00
Lucas Verney daf16d88ba Sphinx-generated doc 2017-12-05 14:56:08 +01:00
Lucas Verney 64f6e8886b Deduplicate the available backends list 2017-11-27 15:05:13 +01:00
Lucas Verney 4a65f52475 Do not store personal data by default, let user overload this behavior
through config.

Fixes #80.
2017-11-17 16:14:11 +01:00
Lucas Verney 1d6233e5ca Completely fix https://github.com/Phyks/Flatisfy/issues/10 2017-10-24 16:56:23 -04:00
Lucas Verney 7fd44b7e8f No longer make queries with more than three cities
Some postal codes correspond to multiple cities, then sometimes we were
spawning queries with more than three cities. This should no longer be
the case. This fixes https://github.com/Phyks/Flatisfy/issues/10.
2017-10-24 15:50:19 -04:00
Lucas Verney 6ed484bb8b Merge branch 'foncia' into 'master'
Add support for Foncia backend from Weboob

See merge request !5
2017-06-26 13:33:15 +02:00
Lucas Verney f1df23dc29 Linting 2017-06-20 13:37:54 +02:00
Lucas Verney 054c5679bb Handle exceptions raised when fetching details
Weboob does handle the raised exceptions when fetching housing posts
through the `WebNip` class. However, when fetching details, we directly
call the Weboob backend method and no exceptions handling is done.

When importing data with a `crontask`, websites may be offline for some
time, especially at night, then leading to a failure in import process.

Let's just handle such exceptions so that an offline website does not
break the whole import process. Details from the temporary offline
websites which could not be fetched will be fetched at next run.

This closes #60.
2017-06-20 13:37:54 +02:00
Lucas Verney bdf8a6b8d2 Handle multiple constraints in the config
All the backend part has been rewritten to handle multiple constraints
in the config (== multiple queries).

Also did some linting.

Still to be done: frontend part and doc.
2017-06-16 16:22:02 +02:00
Lucas Verney 1517d8d30b Add support for Foncia backend from Weboob 2017-06-14 16:30:19 +02:00
Benjamin Bouvier 4beee77a02 Fixes #55: Handle ValueError when fetching detailed info about a flat; 2017-06-14 11:02:49 +02:00
Lucas Verney 982ea995a7 Add a search feature and matching UI elements
Also do some minor UI improvements:
* Add an icon to identify followed flats in tables
* Fix wrong enforced plural for 'flats'
2017-05-03 15:55:08 +02:00
Lucas Verney 589bfdfb13 Better deduplication
Perform deeper deduplication, based on all the available data, and
trying to match common photos.
2017-05-03 15:55:07 +02:00
Lucas Verney bd3e599d12 Handle weboob exceptions, fix issue #25 2017-05-03 15:55:07 +02:00
Lucas Verney 1d98c631e0 Refilter command and backends in config
* Add a refilter command
* Add a backend option in config to only enable some backends.
2017-05-03 15:55:07 +02:00
Lucas Verney 65bd5db98a Fix Decimal issue with JSON 2017-05-03 15:55:06 +02:00
Lucas Verney a57d9ce8e3 Switch to a Vue-based web app
* Init Webpack / Babel / etc setup.
* Build the app using Vue, Vue-router, Vuex.
* i18n

Some backends changes were made to match the webapp development:
* Return the flat status as a single string ("new" rather than
"FlatStatus.new")

* Completely switch to calling Weboob API directly for fetching
* Use Canister for Bottle logging
* Handle merging of details dict better
* Add a WSGI script
* Keep track of duplicates
* Webserver had to be restarted to fetch external changes to the db
* Handle leboncoin module better

Also add contributions guidelines.

Closes issue #3
Closes issue #14.
2017-05-03 15:54:26 +02:00
Lucas Verney d7012e3834
Initial commit 2017-04-13 20:03:59 +02:00