Commit Graph

191 Commits

Author SHA1 Message Date
98ae12d10d Stash 2018-02-08 12:24:32 +01:00
ba40f71aed Define new db tables to host constraints
Also make use of advanced types in SQLAlchemy to clean the db scheme.
2018-02-08 12:24:32 +01:00
bfc27bbb92 Update Flatisfy to handle the latest dev version of Weboob. Fixes #91 and #85. 2018-02-07 19:54:48 +01:00
576c18b597 Fix #116 and incorrect handling of invalid images file in ImageCache 2018-01-30 17:01:31 +01:00
d160962509 Fix CI 2018-01-30 10:36:40 +01:00
ee2880326c Add a way to download photos locally
Fix for #94.
2018-01-28 17:08:53 +01:00
d6b82b24c6 Phone number should not count for as much in duplicates detection + better handling of multiple phone numbers 2018-01-26 10:51:16 +01:00
Phyks
e7218e90f3 Merge branch 'moar-tests' into 'master'
More duplicates tests

See merge request phyks/Flatisfy!23
2018-01-26 10:34:44 +01:00
nicofrand
bb78725a05 Trim whitespaces in string normalization 2018-01-22 13:01:07 +01:00
nicofrand
88087c8628 Address review 2018-01-22 13:01:07 +01:00
nicofrand
9957206abe Add tests with cropped photos 2018-01-22 12:32:26 +01:00
nicofrand
39b3ce6a1d Add test on similar but different flats 2018-01-22 12:31:06 +01:00
nicofrand
83d7792e4c Duplicates score should be enough, removing common photos assertion 2018-01-22 12:30:59 +01:00
nicofrand
4870078599 More duplicates tests 2018-01-21 14:25:44 +01:00
27d601ca21 Fix a bug with roman literals conversion 2018-01-21 12:12:14 +01:00
08599d91de Address a few nits in review 2018-01-21 12:00:30 +01:00
nicofrand
9fa2177087 Add unit tests for image comparison 2018-01-21 11:53:59 +01:00
4b41e6de2d Actually, this should be done the other way 2018-01-21 10:51:37 +01:00
03476dc8a5 Fix last commit about time_to handling 2018-01-21 10:41:22 +01:00
nicofrand
a391d51d67 fix issue with travel time 2018-01-20 21:20:18 +01:00
Phyks
e2bc3c7a85 Merge branch 'numerals' into 'master'
Improve cities fuzzy matching

Closes #112

See merge request phyks/Flatisfy!19
2018-01-20 00:13:41 +01:00
a45eba65c7 Improve cities fuzzy matching
* Convert arabic numerals to roman ones in fuzzy comparison, to ensure
there is no more discrepancies between "Paris 20" and "Paris XX" for
instance. Fix #112 and improve on top of #110.
* Improve handling of opendata postal codes (no more duplicates, better
capitalization).

Note: You should `pip install -r requirements.txt` and rebuild the
database (`python -m flatisfy build-data --config config.json`) after
this commit.

Thanks @nicofrand for building the basic blocks for this!
2018-01-19 11:53:27 +01:00
7bf08adbce Avoid computing multiple times the same photo hash, fix for #111 2018-01-18 15:43:39 +01:00
deeba0e5f2 Disable roman numerals conversion, add extra test 2018-01-18 15:00:21 +01:00
d482d9b6fa Make CI fail if a test fails + a bit of linting 2018-01-18 14:48:28 +01:00
Phyks
6bcfb62e8d Merge branch 'fix-roman-numbers' into 'master'
Fix roman numbers

See merge request phyks/Flatisfy!18
2018-01-18 14:17:57 +01:00
caa79f245b Fix CI, also do not fail if ~/.local directory does not exist. 2018-01-18 14:16:38 +01:00
Nicolas Frandeboeuf
62907a621c Add link to gist 2018-01-18 14:04:39 +01:00
da0252974f Fix an import error in Python 3 2018-01-18 13:59:22 +01:00
nicofrand
771b140705 Fix tests 2018-01-18 13:50:49 +01:00
nicofrand
07955af574 Fix roman numbers convertion 2018-01-18 13:50:49 +01:00
02420d7a1b Use an eye icon rather than a plus icon in FlatsTable. Fix #105. 2018-01-18 11:59:32 +01:00
6b25379fc0 Conditional requirements.txt, including all dependencies 2018-01-18 11:45:32 +01:00
82681c6c27 Disable log coming directly from Canister 2018-01-17 20:24:08 +01:00
80b0384d73 Run new unittests in CI 2018-01-17 13:41:52 +01:00
Phyks
9b840c2fd1 Merge branch 'tests' into 'master'
Add unit tests

See merge request phyks/Flatisfy!17
2018-01-17 13:22:18 +01:00
nicofrand
5b85ad6e59 Add unit tests 2018-01-17 08:43:25 +01:00
48835c0d83 Make "flatisfy" key optional in deep_duplicate computation 2018-01-12 14:48:10 +01:00
46457b014a Avoid too broad ignoring of flats when looking for only some postal codes in a city covered by multiple postal codes. Fix #110. 2018-01-10 20:01:22 +01:00
45c4eca775 Add a logging line after webserver is started.
Also remove useless `debug` config option.
2018-01-10 19:41:51 +01:00
47ce1ba7e0 Ignore duplicates by IDs, no need to even add the duplicate in db 2018-01-10 17:03:18 +01:00
35c88050df Better logging for station metadata detection 2018-01-10 16:46:30 +01:00
083caec041 Update doc according to @nicofrand's suggestions 2018-01-08 14:49:03 +01:00
219b8e156e Fix a bug when throwing an exception with unicode characters from
Weboob.

As reported by @nicofrand.
2018-01-06 10:53:35 +01:00
3f30257b44 Fix spelling in deep_detect 2018-01-05 19:43:07 +01:00
a6b193ae87 Fix missing config arg in deep_detect 2018-01-05 19:01:08 +01:00
f55b6a940b Update Dockerfile to use an entrypoint
Mimmick what Kresus is doing so that generated file are not owned by
root. Fix for #106.
2017-12-30 19:57:14 +01:00
83ff6be409 Better fix for #100 2017-12-30 19:30:32 +01:00
67d1299b15 Consider duplicates cannot belong to the same website, should fix #100. 2017-12-30 15:27:46 +01:00
7196add731 Lint code 2017-12-30 14:45:58 +01:00