APPG Groups and Memberships
Version: 0.28.0. This is the latest version. See all versions.
Description
APPG register with experimental ML membership scrapers.
Contributors
Licences
Download options
Individual tables
Table: Categories
Categories added to APPG by mySociety
Data description
| Column name | Data type | Description | Unique | Required values |
|---|---|---|---|---|
| appg_slug | string | Slugified name of the APPG | No | |
| category_slug | string | Slugified name of the category | No | |
| category_name | string | Nice name of the category | No |
Table: APPG Memberships
APPG Memberships scraped using experimental ML scraper
Data description
| Column name | Data type | Description | Unique | Required values |
|---|---|---|---|---|
| name | string | Original name from the scraper (may contain typos) | No | |
| officer_role | string | Role of the member in the APPG | No | |
| twfy_id | string | TheyWorkForYou ID for the member | No | |
| mnis_id | string | Parliamentary ID for the member | No | |
| canon_name | string | Name from the TWFY database | No | |
| parliament | string | Parliament the APPG belongs to | No | ni-assembly, scottish-parliament, senedd-cy, senedd-en, uk |
| appg | string | Slugified name of the APPG | No | |
| is_officer | boolean | Is the member an officer of the APPG? | No | False, True |
| member_type | string | Type of member (trusting source, not always right) | No | lord, mla, mp, ms, msp, other |
| source | string | Source of the data | No | ai_search, manual, official, parliament |
| last_updated | date | Source observation date for Senedd records; UK register date for UK officers | No | |
| url_source | string | URL of the source of the data | No | |
| removed | boolean | Is this a previous member who is no longer a member. | No | False |
| registration_id | string | Senedd registration identity, including term and official body ID; null for other parliaments | No | |
| senedd_term | integer | Senedd term number; a registration never carries membership into another term | No | |
| valid_from | date | Known membership or registration start, inclusive; null when unknown | No | |
| valid_until | date | Latest possible end, exclusive; not evidence of continuous membership before this date | No | |
| end_reason | string | Reason for the validity bound: term_ended, left_senedd, no_longer_listed or registration_closed | No | |
| observed_on | date | First dated observation of this membership spell or registration; not its start date | No |
Table: APPG Register
APPG Register as a spreadsheet
Data description
| Column name | Data type | Description | Unique | Required values |
|---|---|---|---|---|
| slug | string | Slugified name of the APPG | No | |
| title | string | Title of the APPG | No | |
| purpose | string | Purpose of the APPG | No | |
| category | string | Category of the APPG | No | , Country, Area or Region Group, Subject Group |
| parliament | string | Parliament the APPG is in | No | ni-assembly, scottish-parliament, senedd-cy, senedd-en, uk |
| registrable_benefits | string | Registrable benefits of the APPG | No | |
| source_url | string | URL of the APPG on the Parliament website | No | |
| categories | string | Pipe seperated list of (mysociety added) categories for the APPG | No | |
| registered_contact_name | string | Name of the registered contact | No | |
| registered_contact_address | string | Address of the registered contact | No | |
| registered_contact_email | string | Email of the registered contact | No | |
| public_enquiry_point_name | string | Name of the public enquiry point | No | |
| public_enquiry_point_email | string | Email of the public enquiry point | No | |
| secretariat | string | Name of the secretariat | No | |
| website | string | URL of the APPG website | No | |
| website_status | string | Status of the APPG website | No | bad_search, manual, no_search, register, search |
| detailed_benefits | string | Json dict of the benefits of the APPG | No | |
| date_of_most_recent_agm | date | Date of the most recent AGM | No | |
| published_income_expenditure_statement | boolean | Published income and expenditure statement | No | |
| reporting_year | string | Reporting year of the APPG | No | |
| next_reporting_deadline | date | Next reporting deadline for the APPG | No | |
| registration_id | string | Senedd registration identity, including term and official body ID; null for other parliaments | No | |
| senedd_term | integer | Senedd term number; a registration never carries membership into another term | No | |
| valid_from | date | Known membership or registration start, inclusive; null when unknown | No | |
| valid_until | date | Latest possible end, exclusive; not evidence of continuous membership before this date | No | |
| end_reason | string | Reason for the validity bound: term_ended, left_senedd, no_longer_listed or registration_closed | No | |
| observed_on | date | First dated observation of this membership spell or registration; not its start date | No |
Table: Senedd CPG members history
Historical and current Senedd CPG evidence, bounded to its term. Unknown start and observation dates remain null. These records do not establish continuous historical membership.
Data description
| Column name | Data type | Description | Unique | Required values |
|---|---|---|---|---|
| name | string | Original name from the scraper (may contain typos) | No | |
| officer_role | string | Role of the member in the APPG | No | |
| twfy_id | string | TheyWorkForYou ID for the member | No | |
| mnis_id | string | Parliamentary ID for the member | No | |
| canon_name | string | Name from the TWFY database | No | |
| parliament | string | Parliament the APPG belongs to | No | senedd-cy, senedd-en |
| appg | string | Slugified name of the APPG | No | |
| is_officer | boolean | Is the member an officer of the APPG? | No | False, True |
| member_type | string | Type of member (trusting source, not always right) | No | ms, other |
| source | string | Source of the data | No | official, parliament |
| last_updated | date | Source observation date for Senedd records; UK register date for UK officers | No | |
| url_source | string | URL of the source of the data | No | |
| removed | boolean | Is this a previous member who is no longer a member. | No | False |
| registration_id | string | Senedd registration identity, including term and official body ID; null for other parliaments | No | |
| senedd_term | integer | Senedd term number; a registration never carries membership into another term | No | 6, 7 |
| valid_from | date | Known membership or registration start, inclusive; null when unknown | No | |
| valid_until | date | Latest possible end, exclusive; not evidence of continuous membership before this date | No | |
| end_reason | string | Reason for the validity bound: term_ended, left_senedd, no_longer_listed or registration_closed | No | |
| observed_on | date | First dated observation of this membership spell or registration; not its start date | No |
Table: Senedd CPG register history
Historical and current Senedd CPG evidence, bounded to its term. Unknown start and observation dates remain null. These records do not establish continuous historical membership.
Data description
| Column name | Data type | Description | Unique | Required values |
|---|---|---|---|---|
| slug | string | Slugified name of the APPG | No | |
| title | string | Title of the APPG | No | |
| purpose | string | Purpose of the APPG | No | |
| category | string | Category of the APPG | No | |
| parliament | string | Parliament the APPG is in | No | senedd-cy, senedd-en |
| registrable_benefits | string | Registrable benefits of the APPG | No | |
| source_url | string | URL of the APPG on the Parliament website | Yes | |
| categories | string | Pipe seperated list of (mysociety added) categories for the APPG | No | |
| registered_contact_name | string | Name of the registered contact | No | |
| registered_contact_address | string | Address of the registered contact | No | |
| registered_contact_email | string | Email of the registered contact | No | |
| public_enquiry_point_name | string | Name of the public enquiry point | No | |
| public_enquiry_point_email | string | Email of the public enquiry point | No | |
| secretariat | string | Name of the secretariat | No | |
| website | string | URL of the APPG website | Yes | |
| website_status | string | Status of the APPG website | No | register |
| detailed_benefits | string | Json dict of the benefits of the APPG | No | |
| date_of_most_recent_agm | date | Date of the most recent AGM | No | |
| published_income_expenditure_statement | boolean | Published income and expenditure statement | No | |
| reporting_year | string | Reporting year of the APPG | No | |
| next_reporting_deadline | date | Next reporting deadline for the APPG | No | |
| registration_id | string | Senedd registration identity, including term and official body ID; null for other parliaments | No | |
| senedd_term | integer | Senedd term number; a registration never carries membership into another term | No | 6, 7 |
| valid_from | date | Known membership or registration start, inclusive; null when unknown | No | |
| valid_until | date | Latest possible end, exclusive; not evidence of continuous membership before this date | No | |
| end_reason | string | Reason for the validity bound: term_ended, left_senedd, no_longer_listed or registration_closed | No | |
| observed_on | date | First dated observation of this membership spell or registration; not its start date | No |
Change log
0.9.0
Change in data for resource(s): members
0.8.0
Change in data for resource(s): members
0.7.0
Change in data for resource(s): categories,members,register
0.6.0
Change in data for resource(s): categories,members,register
0.5.4
description changed from 'APPG register with experimental ML membership scrapers. DO NOT REPLY ON 'ai_search' MEMBERSHIP DATA YET - needs further validation. ' to 'APPG register with experimental ML membership scrapers. DO NOT RELY ON 'ai_search' MEMBERSHIP DATA YET - needs further validation. '
0.5.3
description changed from 'APPG register with experimental ML membership scrapers. ' to 'APPG register with experimental ML membership scrapers. DO NOT REPLY ON 'ai_search' MEMBERSHIP DATA YET - needs further validation. '
0.5.2
Minor change in data for resource(s): members
0.5.1
Minor change in data for resource(s): members
0.5.0
Change in data for resource(s): categories,members,register
0.4.0
Existing resource field(s) type changed: published_income_expenditure_statement
0.3.0
New field(s) added to resource: categories
0.28.0
New field(s) added to end of resource: registration_id,senedd_term,valid_from,valid_until,end_reason,observed_on
0.27.0
Change in data for resource(s): categories,members,register
0.26.0
New field(s) added to resource: parliament
0.25.0
Change in data for resource(s): categories,members,register
0.24.0
Change in data for resource(s): categories,members,register
0.23.0
Change in data for resource(s): categories,members,register
0.22.0
Change in data for resource(s): categories,members,register
0.21.0
Change in data for resource(s): categories,members,register
0.20.0
Existing resource field(s) type changed: published_income_expenditure_statement
0.2.0
New field(s) added to end of resource: removed
0.19.0
Change in data for resource(s): categories,members,register
0.18.0
Change in data for resource(s): categories,members,register
0.17.0
New field(s) added to resource: parliament
0.16.0
Change in data for resource(s): members
0.15.0
Change in data for resource(s): members
0.14.0
Change in data for resource(s): members
0.13.0
Change in data for resource(s): members
0.12.0
Change in data for resource(s): members
0.11.0
Existing resource field(s) type changed: published_income_expenditure_statement
0.10.0
Existing resource field(s) type changed: published_income_expenditure_statement
0.1.0
Don't need to increment, first version