aboutsummaryrefslogtreecommitdiffstats
path: root/perllib/Open311
Commit message (Collapse)AuthorAgeLines
* [Oxfordshire] remove open311 hardcodingStruan Donald2018-10-01-4/+0
| | | | | we no longer need some of the hardcoded oxfordshire Open311 overrides so remove them
* [Open311] add customer reference from update to problemStruan Donald2018-10-01-0/+7
| | | | | If an Open311 update has a customer_reference property then add that to the metadata for the problem.
* [Open311] No questionnaires on fetched reports.Matthew Somerville2018-09-18-0/+1
|
* Don’t crash when fetching Open311 requests with missing descriptionDave Arter2018-08-17-1/+1
|
* [Open311] No update text on fixed state move.Matthew Somerville2018-08-06-2/+4
| | | | | | A move between fixed states (presumably from fixed-user to fixed-council) should not count as a state change for the purposes of generating comment text from templates.
* Map Open311 CLOSED status to closed state if extended statuses enabled.Dave Arter2018-06-21-3/+4
| | | | | | | | | | | | | | | | | | | | | The Open311 specification has two values for a report's status: - open: it has been reported. - closed: it has been resolved. FixMyStreet previously mapped 'closed' to 'fixed - council', but this has been causing issues with Open311 endpoints that want to mark a FMS report as closed but not fixed. The mySociety Open311 additions introduce extended statuses, some of which represent a 'closed' state e.g. duplicate, no_further_action, but there are times when a report should simply be closed without any indication why - for example, if open311-adapter is being used to integrate with a council system which has a closed state not represented by the extended statuses. Marking a report as 'closed' on a council system and displaying that as 'fixed' on the FixMyStreet front end is not an ideal situation. This commit changes the mapping of the Open311 'closed' status to the 'closed' FMS state when extended_statuses is enabled.
* [Oxfordshire] use localtime in open311 get update callStruan Donald2018-06-08-0/+2
| | | | | | | | | | As Oxfordshire uses local time and not UTC use that when calling the get update script. Also handle a date with a timezone being passed on the server side. And add some tests in for the oxfordshire open311 endpoint Fixes mysociety/fixmystreet-commercial#1062
* Don’t delete email contacts on devolved bodies.Matthew Somerville2018-06-06-21/+8
| | | | | If we assume that any body with can_be_devolved set is probably a mix of Open311/email, we can ignore any email address contacts for such a body.
* [Bromley] Add asset/PROW ID meta to attributes.Matthew Somerville2018-06-04-0/+19
|
* [Open311] Factor cobrand overrides to functions.Matthew Somerville2018-06-04-14/+28
| | | | [Stevenage] Make sure Other included, like East Herts.
* [Open311] Hide fetched update if no data to show.Matthew Somerville2018-04-27-2/+6
| | | | If no text, photo, or state change, hide the update from display.
* better diagnostics for rejected Open311 problemsStruan Donald2018-04-25-1/+2
| | | | | Add a more helpful error message when a problem fetched over Open311 is rejected for problems with the date.
* Don’t trigger response templates unless problem state changesDave Arter2018-04-23-15/+26
| | | | | | | Response templates won't be triggered unless the problem state or external status code is changed. Fixes #2075
* Merge branch 'open311-update-problem-state'Matthew Somerville2018-04-11-16/+16
|\
| * [Open311] Generally store update state.Matthew Somerville2018-04-10-16/+16
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Previously, an update's problem_state was set via an Open311 update if: * the update timestamp was equal or greater to the report's last update; * the new state was visible, and not equal to the report's current state; * the update wouldn't change the report from a fixed state to another fixed state; * (Oxfordshire) the update wouldn't change the report from any open state to Open. It would also set the report's state to match if the report was currently visible. This mostly worked, but could lead to issues if e.g. the report started life in a non-confirmed state (e.g. we pulled it in already fixed from an external source), as then the update did not record its state and the update display got confused as to the state history. However it did mean there wasn't confusion if a later update than the Open311 update was made on the site itself. This new code will set an update's problem_state if: * the new state is visible; * the update wouldn't change the report from a fixed state to another fixed state; * (Oxfordshire) the update wouldn't change the report from any open state to Open. It will also set the report's state to match if the report is currently visible, changing state, and the update timestamp is equal or greater to the report's last update. So when the report state changes is unchanged, all the conditions still apply, but the update's problem_state is set more often (it will be set regardless of whether the timestamps align, or whether the state matches the report's current state). This could theoretically lead to issues elsewhere, e.g. if an update is left on a report on FixMyStreet and then an Open311 update is pulled in later (but with an earlier timestamp) that changes the state, the report state will not be updated due to the later update being made, though the Open311 update will list the state change, and then the later update might say it changed it back (if it recorded the current state in its problem_state), even though it technically did not. I think this issue is less worrying than the current situation, which can state that a random update has fixed a report when it was the previous update that did, and there will always be such issues with multiple sources of truth for a report status. An alternative would be to allow the Open311 update to override.
* | [Open311] fetch_all option for open311 problem fetchingStruan Donald2018-04-11-7/+17
|/ | | | | | | | | If a body has a `fetch_all_reports` setting in the extra metadata then all reports are fetched over Open311 and processed regardless of age. This is useful for bodies where the API endpoint always returns all the reports as it suppresses the error messages you would otherwise get about reports with invalid dates.
* [BANES] Don’t delete non-Open311 categoriesDave Arter2018-04-10-2/+3
|
* Allow same-time state change from Open311 updates.Matthew Somerville2018-04-06-1/+2
| | | | | | If we've pulled in a report and an update from an external source, both may have exactly the same timestamp, and we do want to record the problem_state in that case.
* Correctly assign problem categories in GetServiceRequestsDave Arter2018-04-04-1/+1
| | | | | | | | FMS uses the Contact->email field for the Open311 service code, and the Contact->category field is the user-friendly service name. The wrong value was being compared previously, resulting in all fetched problems being assigned to the 'Other' category.
* Default to only one hour for GetServiceRequestsDave Arter2018-04-04-1/+1
| | | | Certain endpoints can be slow, so fetch fewer reports at a time.
* Default to last two hours in GetServiceRequestsDave Arter2018-04-04-1/+7
| | | | Also adds script for fetching the last 24hrs of reports
* [Buckinghamshire] Send report_url attribute with Open311 service requestsDave Arter2018-04-03-1/+1
|
* add convert latlong option to open311 body adminStruan Donald2018-03-29-0/+1
|
* optionally convert from EPSG:27700 to WGS84 on report importStruan Donald2018-03-29-2/+7
| | | | | | | When pulling reports in over Open311 it's sometimes useful to be able to accept reports with Easting/Northing rather than latitude/longitude. This adds an option to GetServiceRequests to convert them as they come in.
* Trigger response templates based on external_status_codeDave Arter2018-03-29-3/+10
|
* Fetch and store external_status_code in GetServiceRequestUpdatesDave Arter2018-03-28-0/+9
| | | | | | | If the Open311 endpoint provides the external_status_code field in servicerequestupdates.xml output, it’s stored in each comment’s extra field as well as the problem’s extra field. This will make it possible to trigger response templates based on this value.
* Store server_set automated, but ignore for input.Matthew Somerville2018-03-21-2/+0
| | | | | We do need to store them, so that the sending knows which fields are being requested, but we do not want them output to the client at all.
* permit blank updates to be fetched over Open311Struan Donald2018-03-15-0/+4
| | | | | Add a per body configuration option to allow Open311 updates to contain only a status change, rather than emitting a warning when this happens.
* Deal with 'automated' Open311 service attributes.Struan Donald2018-03-15-0/+2
| | | | | | This is part of the integration with our open311-adapter. The automated property indicates that it's an expected value but either it's going to be set by the server, or appear as a hidden field.
* fetch new problems over open311Struan Donald2018-03-15-30/+172
| | | | | | | | | | This enables the display of existing reports from the back end on FMS if the body is configured to do this. Reports will not be created if they are missing an id, a lat or a long, if the lat/long is outside the area covered by the body, if there is already a report with a matching id, or if we can't parse out the request time.
* [UK] Re-include Bristol in open311-populate-service-listDave Arter2018-01-18-1/+2
| | | | | | | | | | | | Bristol's Open311 endpoint still seems to be returning empty metadata for some services that claim to have metadata. They have made changes to their published services since the change was made to exclude their endpoint, which is causing issues for new reports. Rather than exclude their endpoint entirely from being updated, this commit just silences the noisy error message for Bristol. Reverts the change made in 491eb26e4.
* Store group on Contacts in Open311 PopulateServiceListDave Arter2017-12-05-1/+13
|
* Use response template for Open311 updates without ‘description’ textDave Arter2017-12-04-4/+19
| | | | | | | If an Open311 service request update with an empty description field is received and there is a matching ResponseTemplate for the problem's category & state (and it's marked as auto-response) then the text from that ResponseTemplate will be used for the created update.
* [East Herts] Preserve 'Other' category in PopulateServiceListDave Arter2017-11-29-0/+8
|
* Drop council_states and $visible_states.Matthew Somerville2017-08-29-1/+1
|
* Move FixMyStreet::DB to FixMyStreet::DB::Schema.Matthew Somerville2017-08-09-2/+2
| | | | Store a schema object on FixMyStreet::DB instead.
* [Oxfordshire] Open311 update, no open state switchMatthew Somerville2017-08-02-0/+3
|
* Add inactive state to categories.Matthew Somerville2017-07-14-8/+5
| | | | | A new 'state' column replaces confirmed and deleted, allowing categories to be unconfirmed, confirmed, deleted or inactive.
* Automatically spot Open311 co-ord/ID attributes.Matthew Somerville2016-08-24-6/+6
|
* Remove Open311 endpoint to separate repo.Matthew Somerville2016-08-23-2338/+0
|
* Skip incoming Open311 update if no ID or content.Matthew Somerville2016-08-10-0/+1
|
* [Bristol] Bristol City Council cobrand frontendDave Arter2016-06-17-3/+4
| | | | For mysociety/FixMyStreet-Commercial#766.
* Improve Open311 handling of bad attribute data.Matthew Somerville2016-06-17-1/+1
| | | | | We have seen e.g. an endpoint that is returning 'serviceAttributes' as the child of 'attributes', rather than 'attribute'.
* Fix Open311 service code check.Matthew Somerville2016-06-17-1/+1
| | | | The service code could be "0".
* Fail nicely if Open311 response lacks service codeMatthew Somerville2016-06-15-6/+10
|
* Tidy up Open311 XML handling.Matthew Somerville2016-06-15-27/+7
| | | | | Parse the XML in such a way other parts of the code do not have to worry about single-value folding or the like.
* Skip fetched updates if they're out of date range.Matthew Somerville2016-04-26-2/+7
| | | | | Even when we ask for a specific range of dates, we sometimes get given more in the response.
* Remove some unused cobrands.Matthew Somerville2016-04-20-1/+0
|
* Updates to cpanfile and code for perl 5.20/5.22.Matthew Somerville2016-03-23-1/+1
| | | | | | | | | | | | | | | | | | | | The following modules had bugs that have been fixed for working in recent perls: * List::MoreUtils * Guard * PadWalker * aliased * URI * Convert::NLS_DATE_FORMAT The CGI module was removed from core in 5.20, so include it in the snapshot (I don't think it's actually used, but is a dependency). "{" needs to be escaped in regular expressions, and ~~ should not be used. Fix some tests that expect e.g. a certain hash ordering, to use sorted output or better comparisons.
* Only load images from disk when needed.Matthew Somerville2016-02-23-2/+1
| | | | Fixes #1337.