Data Extraction and Transformation Contractor

Civil Justice, Inc. is requesting proposals from qualified contractors with expertise in database structure evaluation and data munging. We seek a contractor to assess the data structure of multiple Airtable bases to transform that data into JSON objects that are compatible with a Firestore (NoSQL) database.

Please note that this project is constrained by grant funding within FY25.

Key dates include:

• March 10th – RFPs due
• March 15th – Finalists contacted for interviews
• March 17th – March 21st – Interviews conducted, and references checked
• March 24th– Awardee decision announced
• June 30th – All contracted work must be complete, and services invoiced

Project Scope

The selected contractor will be responsible for the tasks below. Please note that the final imports to production will be handled by our development team.

• Data Extraction:
  • Develop and implement a reliable method for extracting data from our Airtable bases, ensuring the proper handling of various data types (e.g. attachments, lookups, linked records) · 

• Data Munging:
  • Clean and standardize the extracted data to ensure consistency and accuracy
  • Transform the exported data- including complex relationships- into JSON objects that adhere to provided NoSQL data models
  • Address data quality issues, including missing values, inconsistencies, and duplicates
  • Implement data validation procedures to ensure data integrity

• Collaborative Data Modeling:
  • Work with development and program personnel to refine data models based on extraction results

• Documentation:
  • Provide comprehensive documentation of the data extraction and transformation procedure for developers to implement at the time of import
  • Document any data quality issues encountered and the solutions implemented

Required Skills and Experience

Proposals must demonstrate the following skills and experience:

• Experience working with Airtable, particularly data exports
• Proven expertise in transforming data into JSON format
• Strong understanding of NoSQL data structures and modeling
• Experience handling large datasets of complex data relationships and transformations
• Familiarity with ETL tools, such as CSV Getter and/or proficiency in scripting languages like php, Python, or JavaScript
• Excellent problem-solving, analytical, collaboration, and documentation skills
• High degree of integrity and confidentiality in working with sensitive data
• Alignment with Civil Justice, Inc.’s mission

Proposal Requirements

Proposals must include the following information: · 

• Company/ Individual Profile:
  •  Company/ Individual name, address, and contact information
  • Overview of the company’s experience and qualifications
  • Relevant project experience, including examples of similar projects · 

• Technical Approach:
  • Description of proposed methodology for data evaluation and transformation, including mention of any tools/technologies to be used.
  • Description of data validation and quality assurance procedures ·

•  Cost Proposal:
  • Detailed breakdown of project costs, including hourly rates and any other applicable fees · 

• References:
  • Contact information for at least three professional references

Deliverables

• A method for Civil Justice to run the data export at a later date, either via an editable script or saved mappings within a tool like CSV Getter that allow modification and rerunning the export as needed
• Documentation that identifies how complex relationships between Airtable fields will translate into JSON objects that are compatible with the Firestore data models

Evaluation Criteria

Proposals will be evaluated based on the following criteria:

• Technical qualifications, experience, and references
• Proposed methodology and approach
• Cost proposal
• Commitment to confidentiality and Civil Justice, Inc.’s values

Submissions

Please compile the Proposal Requirements into a PDF and submit them to tech@civiljusticeinc.org, with the subject “Proposal – Data Extraction and Transformation Services” by March 10th.

All information provided in response to this RFP will be treated as confidential. Civil Justice, Inc. reserves the right to reject a proposal.