If interested in any of the publications or links on this webpage, please contact RIKILLC by emailing RFiene@RIKInstitute.com.
The following brief document and powerpoint slides present the latest information in summary format on the Early Childhood Program Quality Improvement/Indicator Model and the Differential Monitoring Logic Model and Algorithm (ECPQIM/DMLMA(ECPQI2M 2016)(ECPQIM Fiene 2019 2nd Edition)) (#1/2/5/9):
- ECPQIM/DMLMA Brief Collection of Readings: (RJF1A). This document contains the original 2013 paper and the updated 2015 paper describing ECPQIM/DMLMA along with examples of reports and other supporting papers for the model. (#1/2)
- ECPQIM Listing of Publications by Content Area: (ECPQIM PUBLICATIONS) (#1/2)
- ECPQIM/DMLMA Powerpoint Presentation with Notations: (PPT135+ NARA-RIKIN). This powerpoint contains an overview to the ECPQIM/DMLMA model. Here is the presentation from YouTube. (#1/2)
- This graphic (Early Childhood Program Quality Improvement/Indicator Model (ECPQI2M4) & Differential Monitoring Logic Model and Algorithm (DMLMA) Update) summarizes the latest research on ECPQIM/DMLMA (Fiene, 2015a). (#1/2)
- This graphic (Relationship of Comprehensive Reviews (CR) to Key Indicator (KI) or Risk Assessment (RA) Rule Non-Compliance) depicts the relationship amongst comprehensive instruments and key indicators & risk assessment tools (Fiene, 2015b). (#1/2)
- And here is a Seminar Presentation (The Intersection of Translational Research and Implementation Science: An Early Childhood Predictive Analytic Model (ECPQIM4)(Abstract)(Video of the Presentation) Dr Fiene did in 2015 at the Prevention Research Center, Penn State University describing ECPQIM/DMLMA (Fiene, 2015c). (#1/2) In 2017, NARA – National Association for Regulatory Administration hosted a webinar in which Dr Fiene presented the dominant Regulatory Compliance Monitoring Paradigms (Edna Bennett Pierce Prevention Research Center Annoucement). This presentation builds upon and extends the PRC Seminar presentation.
- Powerpoint presentation done as a NARA Webinar (Key Indicators: Regulatory Compliance Monitoring Paradigms)(Regulatory Compliance Monitoring Paradigms Webinar Slides).
- One of the original papers (The Instrument Based Program Monitoring Information System and Indicator Checklist for Child Care) describing ECPQIM, differential monitoring, licensing key indicators and the risk assessment methodologies. (#2)
- A Treatise on Theory of Regulatory Compliance, ECPQIM, Licensing Validation Framework, and Key Indicator, Risk Assessment, Differential Monitoring Methodologies (TRC ECPQIM VAL DM).
- An article utilizing the Theory of Regulatory Compliance in the economic field of finance (Academic Journal of Economic Studies).
There are two national initiatives which demonstrate specific outcomes of the ECPQIM/DMLMA approach: Caring for Our Children Basics and Head Start Key Indicators. The following national publications (OHS, OCC, ACF, ASPE), powerpoint presentations, and webinars provide information about these programs/initiatives based upon differential monitoring, risk assessment and key indicator methodologies.
- Caring for Our Children Basics
- Caring for Our Children Basics Alignment Tool
- Development of the Head Start Key Indicator-C Tool
- Overview of Head Start Key Indicator-C Tool
- Aligned Monitoring System
- OHS Grantee Webcast: Overview of Head Start Monitoring
- Head Start Key Indicator Screener
- Office of Head Start HSKI-C Monitoring Protocol
- Head Start Key Indicator-C (HSKI-C) Review Handbook
- ASPE Monitoring of ECE Programs White Paper
- ASPE Report of 13 Key Indicators of Child Care Quality
- OCC Licensing Brief on Monitoring Strategies for Determining Compliance
- OCC/BUILD/NECQAC/NARA 2017 Efficient and Effective Monitoring in Licensing
- ACF ECD 2015 Accomplishments (CFOCB & HSKI-C Differential Monitoring)
Here is an article Dr Fiene wrote for Child Care Information Exchange about 20 years ago which might get a bit more traction today then it did back in the 1990’s when not as many quality funds were available to states. It would be interesting to see this idea pilot tested in a state or two. The “trilemma” still exists today as it did 20 years ago, so let’s think outside the box and see if creative public policies can have some impact on this continuing problem. Here is a pdf of that article Dr Fiene wrote: Solution to the Child Care Trilemma of Accessibility, Affordability and Quality. The ideas in this article combine several components/elements that Dr Fiene has advocated for from his ECPQIM Paradigm (Fiene, 1971, 1985, 2013, 2015).
These are a series of ECE Quality Studies completed in Pennsylvania from 1996 – 2011 which demonstrate the impact that public policies can have on overall quality of programs:
- The 1996 Study – Professional Development, Training System.
- The 2002 Study – All Early Childhood Settings, Head Start, Preschool, etc. (2002-q-quality_study_final)
- The 2006 Study – Keystone Stars – PA Quality Rating & Improvement System. (2006-q-keystone_stars_evaluation)
- The 2011 Study – Subsidy System, TEACH, Keystone Stars. (2011-crp-report)
More detailed evaluations of quality locally in Pennsylvania, family child care, child care and Head Start.
- Family Child Care Quality in Pennsylvania
- Pennsylvania Head Start & Child Care Quality Comparisons
- Local Pennsylvania Quality
Here are a QRIS ToolKit and Compendium of Measures for use within ECE/QRIS systems:
- OPRE/QRIS Compendium – Tools/Instruments
- OPRE/QRIS TOOLKIT – Overview and Design
Here is the article and comprehensive data base for the Early Childhood Program Quality Improvement and Indicator Model (ECPQIM) Dr Fiene has been suggesting to use as a systems approach for monitoring and evaluating early care and education programs.
- ECPQIM – Early Childhood Program Quality Improvement and Indicator Model Article
- ECPQIM – Early Childhood Program Quality Improvement and Indicator Model Data Base
- ECPQIM International Summary Data Base (DOI: 10.13140/RG.2.2.32695.27048)
The theory, model and methodologies presented in five papers written between 2013 and 2019 give the overall thinking and detailed algorithms for differential monitoring and regulatory compliance:
- 1 TRC – The Theory
- 2 ECPQIM – The Model
- 3 KIS – Key Indicator Methodology
- 4 RAM – Risk Assessment Matrix
- 5 DMLM – Differential Monitoring
TRC ECPQIM KIS WRA DM TECO Algorithm Papers
Based upon the ECPQIM, the Ministry of Education in the Province of Saskatchewan is developing a program quality tool based upon key indicator methodology. This is a very exciting development in that it is a practical application of the ECPQIM through the use of an assessment tool. The tool has 15 key indicators from professional development, curriculum/developmental assessments, family engagement, interactions, environment, and health & safety. It balances compliance with program quality. Below is a draft of the tool:
Two papers that highlight where program monitoring started back in the 1970’s – 1980’s and where it is today in 2020. Many things have changed in 40 years but certain basic concepts and principles have not:
- 1970-1980 CSMTC Program Monitoring Conceptual Framework
- 2020 Program Monitoring & Program Management Approaches Key Principles
These reports give examples of professional development, training system evaluations as well as particular approaches (mentoring, coaching), and the Institute (CAECTI) responsible for developing and completing them:
- Mind in the Making Learning Modules Evaluation
- Evaluation of the Pennsylvania MAPS Project
- Internet Evaluation – Mastering Course Content & Learner Satisfaction in ECE
- Infant Toddler Caregiver Mentoring Program Evaluation
- Infant Toddler Caregiver Mentoring Program Manual
- Capital Area Health & Human Development Institute Report
- CAHHDI 2006 Report
- PRC Five-Year Report
- PRC Ten Year Report
- PRC/CAECTI ECE Intervention Strategies
- Local Pennsylvania Mentoring Evaluation
- Early Childhood Environmental Rating Scale Training
- ASPE/LITES Compelling Models
- QRIS and Coaching Quality Improvement
- ECELS ITQIP Child Care Health Consultants Mentoring/Coaching MCHB Research Project Reports
- ECELS Draft Report
- ECELS ITQIP Letter To Grant Supporters
- ECELS ITQIP Summary
- Journal of Pediatric Health Care article
- Handbook of Early Childhood Education
- Penn State Better Kid Care Infant Toddler Online Coaching Manual
- Evaluation of the BKC Infant Toddler Online Coaching Manual (Final Report)
- Penn State Center for Child Protection iLookOut for Child Abuse Online Training Program
Here is space for manuscripts/documents Dr Fiene is working on with others and will take a bit of time before they are finalized and published:
- 1Cognitive Mapping Manuscript10
- Cognitive Mapping_2.0_V2a
- iLookOut
- NARA Presentation SS – RF
- Creating A Reliable And Viable Approach For Child Presentation April 2018a
- ECPQIM – Lewin – RIKI – Arizona Proposal
- FSLA-VIBE Research Design Proposal
- NARA-RIKI NYC-NYS Proposal
- HMC Phase II Knowl Att
- Practicing Situational Licensing in Adult Care Settings
- BKC Pre-Test Report
- British Columbia Key Indicators
- Validation Methodlogy_Final_2_SS
- IRR Data Methodology_SS_7-10-18
- 1SLIDES PPT KIS INTRO NARA SEMINAR
- Cognitive Mapping
- WA Stepping_Stones_StandardS_Validation_FINAL
- WASHINGTON Standards Validation Analysis_SS7-16
- 4OREGON2 2013
- Cognitive Mapping Manuscript12a
- 1WA RA
- Cognitive Mapping Manuscript First Draft
- TRC Models1
- Fiene Treatise on Regulatory Compliance
- LICENSING MEASUREMENT CHAPTER2
- RIKI Effectiveness and Efficiency Relationship1
- APS Article Methods and Practices1b
- ECPQIM DB Report Fiene July 2019a
- ECPQIMs3 Fiene RIKI 2019
- 2NARA SK KIS Report7b
- Early Childhood Teacher Education UJEC-2019-0070_Proof_hi
- BKC Final Report9
- BKC CCC_InfantToddlerBestPractices
- BKC Final Report13c(1)
- NARA SK RA Study2b4a
- DTSC Theory – Unified Theory
- Regulatory Compliance Law of Diminishing Returns
- NARA WA Validation Measures and Output Study
- WA RIKI FC Home Study Predictor Indicators
- WA FC Home Study PredictorsC2
- WA RIKI FC_PI study_SS.1.9
- NARA SK Validation CCC FCC Report6
- NARA SK ECEPQ Tool1 (1)
- 2NARA SK ELCCPQ Tool1 (2)
- DTSC Theory T=Sm2
- A Guide to Fiene ECEPCPQ Scale2
- WA FC PI
- NARA SK Validation Study Report
- HMC ECRQ-S-19-00394 Mixed Methods
- OHS Indicators Scan2
- OHS Indicators Scan8a
- CHACR LMA Formula Models3 Parents
- CHACR LMA Formula Models3 Agencies
- NARA KIS Webinar1
- Abstract IPP Special Issue Prel H+C Results1
- GPMS PAM Scoring Algorithm
- SK ELCCPQI Tool EAS 1-4e
- Validation Studies CCIE1
Manuscripts in press:
- Storyline Manuscript
- iLookOut HEB Manuscript
- Cognitive Mapping Manuscript
- HMC Chengwu Main Document_APA rjf
- WAFC PI Article
For additional information regarding ECPQIM/DMLMA with examples, please see the following: ECPQIM-DMLMA Examples