Commit Graph

288 Commits

Author SHA1 Message Date
Lucas Verney 4633dd5179 Add a note about running time, see #72 2017-09-27 12:23:19 -04:00
Lucas Verney fa20d0fcbc Fix #73 2017-09-27 00:16:36 +02:00
Lucas Verney 9b087729d3 Fix flatisfy.tools.batch with Python3 2017-09-26 01:04:09 +02:00
Lucas Verney 15eb5a19f6 Clarify doc about modules_path config option, see #71 2017-09-25 10:41:49 -04:00
Lucas Verney 7e35b71c28 Fix an issue with functools, see https://github.com/Phyks/Flatisfy/issues/4 2017-09-24 23:10:07 +02:00
Lucas Verney 88a923c87e Fix for https://github.com/Phyks/Flatisfy/issues/5 2017-09-24 22:51:12 +02:00
Lucas Verney 71729842ad Fix issue #68 2017-09-24 19:22:40 +02:00
Gautier Pelloux-Prayer 9405742445 Add weboob dependency in requirements.txt 2017-09-24 18:55:00 +02:00
Gautier Pelloux-Prayer 28d4b1e36b Add missing brackets for method invokation 2017-09-24 18:54:46 +02:00
Lucas Verney 01e9f7ec0a Merge branch 'cost-per-sq-meter' into 'master'
Display cost per square meter

See merge request !8
2017-07-11 15:08:41 +02:00
Lucas Verney 215fe14d01 Better email notifications
Rework a bit on top of @bnjbvr's MR to add basic email notifications
support.

* Cleaned the code a bit.
* Add a `Date` and a `Message-ID` header to improve the spam score.

Thanks a lot @bnjbvr's for the MR!
2017-07-06 15:06:13 +02:00
Benjamin Bouvier 23bbee8271 Adds basic email notifications when new flats have been found (fixes #47). 2017-07-06 15:06:13 +02:00
Lucas Verney 4c07fc8ba1 Merge branch 'better-dedup' into 'master'
Optimize photo comparisons

Closes #41 and #59

See merge request !9
2017-06-29 12:04:44 +02:00
Lucas Verney be43206d4b Merge branch 'fix-slider' into 'master'
Fix image slider perspective

See merge request !3
2017-06-29 12:00:51 +02:00
Benjamin Bouvier 6a0681fc99 Optimize photo comparisons; fixes #41, fixes #59 2017-06-28 22:37:13 +02:00
Benjamin Bouvier 26e2cdefbe Display cost per square meter; 2017-06-28 22:03:20 +02:00
Lucas Verney 210192d09c Rework a bit on top of bnjbvr's fix for #49.
* Remove the text-decoration due to the use of links
* Make the link element occupy the whole table cell, without padding
* Use `router-link` instead of `a` tag
2017-06-26 16:26:35 +02:00
Benjamin Bouvier aac6b63e0a Use simple anchors for flat details; 2017-06-26 15:52:51 +02:00
Lucas Verney 6ed484bb8b Merge branch 'foncia' into 'master'
Add support for Foncia backend from Weboob

See merge request !5
2017-06-26 13:33:15 +02:00
Lucas Verney a9ac5484e0 Rework Docker image and add some doc.
Thanks @bnjbvr for the contribution!

This closes #15.
2017-06-21 15:10:56 +02:00
Benjamin Bouvier 4c558ef182 Basic docker image; 2017-06-21 12:11:29 +02:00
Lucas Verney 5c171a8356 Do not constrain too much the minimum zoom level of the flats map. 2017-06-20 16:32:27 +02:00
Lucas Verney 78b9ebf04e Better handling of phone links
Some Weboob backends were returning multiple phone numbers
(comma-separated) or phone numbers in different formats (with or without
spaces, with or without separating dots, etc).

This commit harmonizes all of this so that all phone links will be
rendered correctly and be usable to call in a single click.

Related, https://git.weboob.org/weboob/devel/merge_requests/42.
2017-06-20 14:20:54 +02:00
Lucas Verney f1df23dc29 Linting 2017-06-20 13:37:54 +02:00
Lucas Verney 054c5679bb Handle exceptions raised when fetching details
Weboob does handle the raised exceptions when fetching housing posts
through the `WebNip` class. However, when fetching details, we directly
call the Weboob backend method and no exceptions handling is done.

When importing data with a `crontask`, websites may be offline for some
time, especially at night, then leading to a failure in import process.

Let's just handle such exceptions so that an offline website does not
break the whole import process. Details from the temporary offline
websites which could not be fetched will be fetched at next run.

This closes #60.
2017-06-20 13:37:54 +02:00
Lucas Verney 8e9cb2c1c7 Add a note about IRC channel 2017-06-20 11:04:05 +02:00
Lucas Verney 6e12490fbd Add some doc about CLI option and better informative message 2017-06-19 17:20:53 +02:00
Lucas Verney 082d177f19 More informative error message when matching accidentally a wrong postal code. See #64 for more context. 2017-06-19 17:15:42 +02:00
Lucas Verney 25f2e71264 Partial fix for #62 (documentation) 2017-06-19 16:26:12 +02:00
Lucas Verney edb7b822d2 Multiple constraints in config and Tcl data
**Note**: This new feature requires a modification of the SQLite database used by Flatisfy. If you don't care about your current database, you can just remove it and do a reimport. Otherwise, you should do the following modifications manually:

* Add a [flatisfy_constraint](ed7e9dfc1a/flatisfy/models/flat.py (L89)) VARCHAR field in the flats table.
* Create [this table](ed7e9dfc1a/flatisfy/models/public_transport.py (L24-32)) for public transport data and [this one](ed7e9dfc1a/flatisfy/models/postal_code.py (L24-34)) for postal codes data.

Closes #58

See merge request !10
2017-06-19 16:12:17 +02:00
Lucas Verney ed7e9dfc1a Add a CLI argument to import only a given constraint. Drop the necessary constraint. 2017-06-19 16:08:06 +02:00
Lucas Verney b7f9427d53 Fix GPS position import of Tcl stations
Tcl stations GPS coordinates are given as `lng, lat` and not `lat, lng`
hence it was not working because the found stations were too far from
the housing post location, as reported by @bnjbvr.

This commit should fix this.
2017-06-19 14:25:02 +02:00
Lucas Verney c4f6a80b0c Fix a StopIteration error in web API 2017-06-19 12:01:55 +02:00
Lucas Verney b187a106e4 Avoid loading multiple times the same data
There was a bug in `data.py` which made it load the same data as many
times as the number of postal codes in constraints. This is now fixed.
2017-06-19 12:01:10 +02:00
Lucas Verney d396d33506 Rewrite doc and frontend to match new constraints in config 2017-06-16 16:56:59 +02:00
Lucas Verney bdf8a6b8d2 Handle multiple constraints in the config
All the backend part has been rewritten to handle multiple constraints
in the config (== multiple queries).

Also did some linting.

Still to be done: frontend part and doc.
2017-06-16 16:22:02 +02:00
Lucas Verney 12a55e64be Add support for Tcl data
This closes #58.
2017-06-15 15:52:11 +02:00
Lucas Verney 82a88590b6 Rewrite data files management, to make it more modular
This is to prepare for the integration of Tcl data, see #58.
2017-06-15 15:48:16 +02:00
Lucas Verney e04e8a0eab Update getting started doc to add tips 2017-06-15 13:48:25 +02:00
Lucas Verney 947f53252a Explain how to enable new Weboob backends in Flatisfy in CONTRIBUTING.md 2017-06-14 16:35:36 +02:00
Lucas Verney 1517d8d30b Add support for Foncia backend from Weboob 2017-06-14 16:30:19 +02:00
Lucas Verney 3469035f4a Towards more modular system for data files
Also use `lru_cache` to do some memoization on data files loading
function, and speed up everything a bit.
2017-06-14 15:29:33 +02:00
Lucas Verney b3ae71a8be Merge branch 'valueerror' into 'master'
Fixes #55: Handle ValueError when fetching detailed info about a flat

Closes #55

See merge request !1
2017-06-14 11:08:17 +02:00
Benjamin Bouvier 4beee77a02 Fixes #55: Handle ValueError when fetching detailed info about a flat; 2017-06-14 11:02:49 +02:00
Lucas Verney 969c6ab0fe There are up to 3 passes available, the `--passes` argument constraint should match. 2017-06-14 10:50:02 +02:00
Lucas Verney f52b07b869 No need for unicode
Missed it while reviewing !2, but as we use `from builtins import str`, there is no need to use `unicode`.
2017-06-14 10:48:17 +02:00
Lucas Verney bd1e1d2068 Update documentation
Add a section about common arguments for all subcommands. Closes #56.
2017-06-14 10:46:38 +02:00
Lucas Verney b889d0e4f3 Update CONTRIBUTING.md
Closes #57.
2017-06-14 10:31:13 +02:00
Lucas Verney e96add4013 Remove useless mention of required Weboob MR in README.md. 2017-06-14 10:29:38 +02:00
Lucas Verney 577abafa07 Merge branch 'config-check' into 'master'
Catch the right error when the constraint type name is not set

See merge request !2
2017-06-14 10:28:33 +02:00