Penelitian vs Evaluasi

by: Nils Aria Zulfianto

Sumber:
U.S. Department of Health and Human Services
Centers for Disease Control and Prevention.
Office of the Director, Office of Strategy and Innovation.
Introduction to program evaluation for public health
programs: A self-study guide. Atlanta, GA: Centers
for Disease Control and Prevention, 2011.
OCTOBER 2011
Konsep Prinsip Penelitian Prinsip Evaluasi
Planning Scientific method Framework for program
State hypothesis. evaluation
Collect data. Engage stakeholders.
Analyze data. Describe the program.
Draw conclusions. Focus the evaluation
design.
Gather credible evidence.
Justify conclusions.
Ensure use and share
lessons learned.

Decision Investigator- Stakeholder-controlled

Making controlled Collaborative.
Authoritative.
Konsep Prinsip Penelitian Prinsip Evaluasi
Standards Validity Repeatability program
Internal (accuracy, evaluation standards
precision). Utility.
External Feasibility.
(generalizability). Propriety.
Accuracy.

Questions Facts Values

Descriptions. Merit (i.e., quality).
Associations. Worth (i.e., value).
Effects. Significance (i.e.,
importance)
Konsep Prinsip Penelitian Prinsip Evaluasi
Design Isolate changes and Incorporate changes and
control account for
circumstances circumstances
Narrow experimental Expand to see all domains of
influences. influence.
Ensure stability over Encourage flexibility and
time. improvement.
Minimize context Maximize context sensitivity.
dependence. Treat contextual factors as
Treat contextual factors essential information
as confounding (e.g., system diagrams, logic
(e.g., randomization, models, hierarchical or
adjustment, statistical ecological modeling).
control). Understand that comparison
Understand that groups are optional (and
comparison groups are sometimes harmful).
a necessity.
Konsep Prinsip Penelitian Prinsip Evaluasi
Data Sources Sources
Collection Limited number Multiple (triangulation
(accuracy preferred).
preferred). Sampling strategies are
Sampling strategies critical.
are critical. Concern for protecting
Concern for human
protecting human subjects, organizations, and
subjects. communities.

Indicators/Measures Indicators/Measures
Quantitative. Mixed methods (qualitative,
Qualitative. quantitative,
and integrated).
Konsep Prinsip Penelitian Prinsip Evaluasi
Analysis & Timing Timing
Synthesis One-time (at the Ongoing (formative and
end). summative).

Scope Scope
Focus on specific Integrate all data.
variables.

Judgments Implicit Explicit

Attempt to remain Examine agreement on
value-free. values.
State precisely whose
values are used.
Konsep Prinsip Prinsip Evaluasi
Penelitian
Conclusions Attribution Attribution and
Establish time contribution
sequence. Establish time
Demonstrate sequence.
plausible Demonstrate plausible
mechanisms. mechanisms.
Control for Account for alternative
confounding. explanations.
Replicate Show similar effects in
findings. similar contexts.
Konsep Prinsip Penelitian Prinsip Evaluasi
Uses Disseminate to Feedback to stakeholders
interested Focus on intended uses by
audiences intended
Content and format users.
varies to maximize Build capacity.
comprehension.
Disseminate to interested
audiences
Content and format varies
to maximize
comprehension.
Emphasis on full disclosure.
Requirement for balanced
assessment.
 Penelitian vs Evaluasi

by: Nils Aria Zulfianto

Sumber:
Isaac, Stephen; William B. Michael
Handbook of Research and Evaluation, 2nd ed.
EdITS Publishers, Sandiego, California, 1990.
Karakteristik Penelitian Evaluasi
Tujuan Pengetahuan baru Pencapaian misi,
penyampaian produk
Outcome Kesimpulan Umum Keputusan spesifik
Nilai Penjelasan, Penentuan keuntungan dan
kekuatan Peramalan utilitas sosial
Dorongan Keingintahuan dan Kebutuhan dan tujuan
ketidaktahuan
Dasar Hubungan, Ujung dari suatu proses
kosnseptual penyebab dan
dampak
Kunci Uji hipotesis Penilaian pencapaian tujuan
penting
Karakteristik Penelitian Evaluasi
Pola pikir 1. Metode eksperimen 1. Pendekatan sistem

E: T1 X T2 Input-proses-output
C: T1 T2
2. Metode korelasional 2. Pendekatan objektif
rxy objective-means-measures
Disiplin Kontrol dan manipulasi Program Planning
varians Management
Kriteria Validitas internal dan Isomorphism (kecocokan
eksternal antara yang diharapkan
dengan yang didapatkan),
dan kredibilitas
Tipe Murni dan terapan Formatif-summatif
Fungsional True dan Quasi Expt Proses- Produk
 Alasan Evaluasi
Untuk memonitor kemajuan pencapaian
tujuan
Menentukan apakah komponen program
menghasilkan kemajuan yang diinginkan
sesuai dengan outcome
Dapat membandingkan antara kelompok
khususnya pada kelompok populasi
 Alasan Evaluasi
Menjustifikasi kebutuhan pendanaan dan
dukungan lanjut
Mencari peluang untuk perbaikan mutu yang
berkelanjutan.
Menjamin bahwa program yang efektif dapat
dipertahankan dan sumberdaya yang ada
tidak dihamburkan untuk program yang tidak
efektif