Pro Services: Centralized Data Management System Updates and Maintenance
Closing Date: September 9, 2022
The Centralized Data Management System (CDMS) was developed by the CTUIR in 2013, which they distributed in 2018 as an open-source software application to two other tribes: the NPT and the CTWSRO, and to CRITFC to collect, store, and manage aquatic scientific Research, Management and Evaluation (RM&E) data. The system comprises a local server or web-based application and many datastores for RM&E and fish management projects. The CTUIR developed the CDMS application using an ASP.NET framework and MSSQL server back-end with an AngularJS front-end. Application versioning is managed with Git and synchronized across the four different builds through GitHub. The YN developed a different solution, the Information Management System/Status and Trends Reporting System (IMS/STAR).
The CRITFC is soliciting proposals from Contractors who can provide upgrade solutions and ongoing technical support to improve functionality, UI/UX, security, automate updates/alpha testing of code updates, and who can propose a solution and architecture to centralize the CDMS application.
This page is a summary. Download complete Request for Proposal here.
The custom-built CDMS is a web-based information management system built as a Single Page Application (SPA) using the ASP.Net WebAPI with AngularJS and is integrated with ArcGIS Enterprise. CDMS uses SQL server for the storage of tabular and geographic data. The system is in production and used at CTUIR for managing RM&E Fisheries data, Tribal Planning Office permits and applications and at NPT, CTWSRO and CRITFC for RM&E fisheries and other aquatic data, as well as for Fisheries Management projects. It is a versatile system used for a variety of purposes which provides secure long-term repositories of authoritative data and reporting capabilities.
There are four complete and functioning CDMS applications; one each housed at CTUIR, at the CRITFC, the NPT, and at the CTWSRO. Currently, the CTUIR version 2.0 has more functionality for a wider variety of uses, and a more current Angular version than the other CDMSs. The CTUIR deployed Jenkins to provide a Continuous Integration/Continuous Delivery (CI/CD) environment that can automate some building, testing and deployment of the application. We are not yet using Jenkins for the other three CDMS builds (CRITFC, CTWSRO, and NPT).
Current Centralized Data Management System (CDMS) Features
The CDMS houses datasets, called “datastores” in a centralized data repository for long-term authoritative RM&E data for aquatic systems. For example, there are datastores for Deschutes River water temperature data and Chinook Salmon spawning ground data collected from the Hood River of Oregon. Features include:
- Data input is enabled with a web-based data entry interface for manual data input, via importing data from an Excel or CSV file , or by using automated data migration routines to extract, transform, and load data from electronic data collection devices in the field, with such applications as Esri’s Survey123, to the CDMS SQL back-end database.
- CDMS currently only provides access to individual projects’ datasets using the application’s query tool for data exporting.
- Extracting data directly from CDMS (i.e., project data sets) is generally accomplished by export to CSV files via querying individual project data sets. SQL Server Reporting Services (SSRS) can also be accessed from within CDMS for custom query products to include data from entire data stores.
- Multi-project data from data stores can also be extracted from the back-end SQL database via queries by data management staff, scheduled SQL Server Integration Services (SSIS) script tasks to generate predefined outputs, or by utilizing an API with 3rd party applications (e.g., R, Python, Tableau, etc.).
- Data migration and exchange: Legacy datasets can be directly imported from CSV or Excel files or uploaded with SSIS data migration routines using SQL scripts. CDMS utilizes API’s, with proof of concept was completed, for data flow between CDMS and StreamNet’s Coordinated Assessments eXchange data system; from the CDMS to EPA’s Exchange Network nodes; and between CDMS and PTAGIS PIT tag database. Some of these data pipelines are currently in production for some of the datastores at some of the tribes.
SCOPE OF SERVICES
The CRITFC is requesting proposals from qualified Contractors for web and integration of native application support for the CDMS and to provide minor support as requested for the YN IMS system. Our goals are to, in order of importance: 1. synchronize the 4 applications by creating an up-to-date “main” Tribal CDMS branch which integrates CTUIR’s recent features and bug fixes, with updated versions of Angular and other supporting applications; 2. coordinate with data stewards from each member tribe to integrate the updated main Tribal CDMS branch into each Tribe’s independent branch; 3. develop and document the workflow and steps necessary to keep each branch up to date with new features, bug fixes, and software updates originally derived from CTUIR or other developers; 4. As time/monies allow, implement UI/UX improvements and application functionality as prioritized.
The scope of services will include, but is not limited to a variety of technical issues including:
- Developing priority features and functional improvements in the custom data management web application (CDMS): one simple example is to update the AG grid to allow autosizing of text boxes.
- UI/UX application design improvements, including mobile/responsive design.
- Employ or develop an automated testing solution for front-end and back-end QA/QC after new code commit installations.
The successful contractor will complete the following specific tasks:
- Incorporate back-end and front-end commits from CTUIR’s CDMS GIT branches into the corresponding Tribal CDMS branches.
- Manage and maintain the Tribal CDMS branch to include any additional updates from CTUIR in addition to improvements made under this agreement.
- Address priorities requested to improve the user interface design of the CDMS.
Given time and resources, ideally:
- Assist with planning implementation of a CI/CD pipeline to develop workflow for improvements during use of the application.
- Development or deployment of existing integration test framework so that we can run a suite of tests against CDMS that would go through major use cases, before major upgrade releases.
- Development of front-end build automation (similar to WebPack) to improve performance.
Proposals should be able to recommend a solution which meets these guidelines for CRITFC:
- Prioritizes CRITFC-ITMD identified tasks within the first 1 month of the contract
- Identifies a clear process for communicating with the Development Team
- Identifies a workflow solution for managing requests, ideally an application for development of software
- Ensures security of all web sites and supports the best interests of CRITFC
- Clearly defines the process for development, testing and implementation of solutions.
- Incorporate CTUIR CDMS’s 2.0 updates into the current Tribal CDMS branch (v2.3)
- Update from AngularJS to most recent Angular, or ideally switch to React, or Vue or similar.
- Improve location handling: we require the ability to lookup projects by location.
- Improve Date/time fields for better functionality.
- All programming improvements will be integrated into the Tribal CDMS branch which the Contractor will use to commit and integrate new code. The Contractor will manage and maintain the Tribal CDMS branch to include all production-ready fixes and updates
- Extensive documentation for GitHub changes, branches, code commits is required.
- Bugs, defects, and features will be tracked in GitHub and Contractor will participate in our workflow to address and repair introduced bugs as needed.
- Initial technical support will be required to introduce new features to end-users and address introduced bugs.
- Documentation of introduced code and features is required.
- Improvements will be tested by Tribal staff and rolled out to production after acceptance.
This is a telework contract and all work will be done remotely. Identified staff will be required to pass a security background evaluation and sign Non-Disclosure agreements.
CRITFC Motor Vehicle Policy
The information on this page is does not include the entire RFQ. Click here to download the complete RFQ as a PDF.
We anticipate that the contractor whose proposal is the best solution for our project will be selected within 15 days of submission deadline of September 9, 2022). We will notify all contractors, whether they are disqualified, rejected, or unsuccessful although responsive.
Proposals must contain all information requested in the RFQ. The CRITFC will not consider additional information submitted after the closing date and may reject incomplete proposals.
Contractors must submit a digital copy (via email) of their proposal to Sara K. Pennington at email@example.com
Disregard the content below as it is part of the job listing template and irrelevant to the RFQ selection process.
Submit by mail:
Attn: Human Resources
700 NE Multnomah Street, Suite 1200
Portland, OR 97232
Hiring preference will be given to qualified enrolled members of the four CRITFC member tribes (Warm Springs, Yakama, Umatilla, and Nez Perce) and other federally recognized tribes and Alaskan Natives. Veterans will also be given preference.
CRITFC is committed to building a culturally inclusive community and a work environment that respects and inspires every person. Members of historically marginalized groups including women, people of color, those with disabilities, members of the LGBTQ+ community, those who have served in the military, and members of other underrepresented communities are invited to apply.
CRITFC will consider non-citizen applicants who are authorized to work in the U.S. If not authorized to work in the U.S., CRITFC will provide reasonable support and accommodations to the candidate in obtaining U.S. work authorization. With the exception of certain employer required costs, CRITFC will not pay for costs related to applicant’s legal representation, filings for work authorization or immigration, or other costs related to obtaining work authorization.
*Please note: the term “Commission” as used in this description refers to CRITFC’s governing body. CRITFC is a tribal organization that is wholly owned and governed by the Nez Perce Tribe, the Confederated Tribes of the Umatilla Indian Reservation, The Confederated Tribes of the Warm Springs Reservation of Oregon, and the Confederated Tribes and Bands of the Yakama Nation. As a tribal organization, CRITFC is subject to a unique blend of policies and laws.