
{"id":9158,"date":"2021-09-13T20:06:23","date_gmt":"2021-09-13T20:06:23","guid":{"rendered":"https:\/\/esperanzaunited.org\/?post_type=cde-knowledge-base&#038;p=9158"},"modified":"2025-10-08T14:47:26","modified_gmt":"2025-10-08T19:47:26","slug":"developing-questions","status":"publish","type":"cde-knowledge-base","link":"https:\/\/esperanzaunited.org\/en\/knowledge-base\/building-evidence\/developing-questions\/","title":{"rendered":"Developing questions"},"content":{"rendered":"\t\t<div data-elementor-type=\"wp-post\" data-elementor-id=\"9158\" class=\"elementor elementor-9158 elementor-10448\">\n\t\t\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-5adb6eb1 elementor-section-boxed elementor-section-height-default elementor-section-height-default tf-sticky-section tf-sticky-no\" data-id=\"5adb6eb1\" data-element_type=\"section\" data-e-type=\"section\" data-settings=\"{&quot;tf_sticky&quot;:&quot;no&quot;}\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-4c4d5b5b\" data-id=\"4c4d5b5b\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-60bcb05a elementor-widget elementor-widget-text-editor\" data-id=\"60bcb05a\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<h3 id=\"h.p9m6mybd89au\" class=\"c21\"><span class=\"c1\">Developing questions<\/span><\/h3><p class=\"c7\"><span class=\"c1\">Consider inviting community members to contribute to the model development. Think about a logic model as a \u201cliving\u201d document, flexible, open to different perspectives, and changing as the program grows and changes too.<\/span><\/p><p class=\"c7\"><span class=\"c1\">Logic model discussions can help spur evaluation questions about the process, activities, or outcomes of programs. We also may want to think about who the program serves, and how we might document adaptations if we are adopting a program developed elsewhere.<\/span><\/p><blockquote><p>Note from la cocina: Why would we adapt programs?<\/p><p>Even though we typically think of recipes working best when we remain faithful to the original recipe, in practice we are in the process of adapting all the time. For instance, we might have a feeling teens and adults like their plate spicy, but we leave out the hot stuff for the younger children.<\/p><\/blockquote><h4 id=\"h.f1sczt7t5ql3\" class=\"c48 c119\"><span class=\"c4\">Collecting, analyzing, and interpreting data<\/span><\/h4><p class=\"c7\"><span class=\"c1\">Community members and staff are wonderful resources for determining how to best collect data, because they often are very familiar with the barriers to data collection, such as time and childcare needs.<\/span><\/p><p class=\"c7\"><span class=\"c26 c19\">On the other hand a common challenge in participatory evaluation is engaging community members and other members of your evaluation team in data analysis and interpretation. An\u00a0<\/span><span class=\"c11\"><a class=\"c3\" href=\"https:\/\/esperanzaunited.org\/en\/knowledge-base\/building-evidence\/choosing-an-external-evaluator\/\">evaluation consultant<\/a><\/span><span class=\"c1\">\u00a0will have training in social science research methods and can add helpful skills to your team, but that doesn\u2019t mean you can\u2019t include others in these important steps of the evaluation. In this section we present two strategies to make the analysis part of the evaluation more inclusive. Overall, holding participatory data analysis meetings is a way to engage all stakeholders in making sense of the data you collect.<\/span><\/p><h4>Participatory evolution tools: Word for qualitative data analysis and visualization<\/h4><p><span class=\"c1\">Qualitative data from focus groups or interviews usually results in clumps of data. Whether it is in the form of transcripts or open-ended responses to a survey you administered. It can seem overwhelming to make sense of such data. A good starting point is to use the Wordle tool which can help you see what themes emerge from the data. The themes are represented by text size based on the frequency they appear in a particular post. \u00a0For qualitative data analysis, this tool can be used to establish initial codes for further analysis of the data. For stakeholders, it can provide immediate insight into relevant themes that may emerge from the data prior to waiting for the in-depth analysis.<\/span><\/p><p><span class=\"c26 c19\">For example, a <a href=\"https:\/\/monkeylearn.com\/word-cloud\/\">Wordle<\/a> of the\u00a0<\/span><span class=\"c11\"><a class=\"c3\" href=\"https:\/\/esperanzaunited.org\/en\/knowledge-base\/building-evidence\/culturally-specific-principles\/\">Cultural-Specific Principles<\/a><\/span><span class=\"c1\">, revealed the following Wordle:<\/span><\/p><p><img fetchpriority=\"high\" decoding=\"async\" class=\"alignnone size-full wp-image-9593\" src=\"https:\/\/ogsite.kinsta.cloud\/wp-content\/uploads\/2021\/09\/Campaign-Materials15-1.jpg\" alt=\"\" width=\"1000\" height=\"372\" srcset=\"https:\/\/esperanzaunited.org\/wp-content\/uploads\/2021\/09\/Campaign-Materials15-1.jpg 1000w, https:\/\/esperanzaunited.org\/wp-content\/uploads\/2021\/09\/Campaign-Materials15-1-600x223.jpg 600w, https:\/\/esperanzaunited.org\/wp-content\/uploads\/2021\/09\/Campaign-Materials15-1-300x112.jpg 300w, https:\/\/esperanzaunited.org\/wp-content\/uploads\/2021\/09\/Campaign-Materials15-1-768x286.jpg 768w\" sizes=\"(max-width: 1000px) 100vw, 1000px\" \/><\/p><h4 class=\"c99\"><span class=\"c1\">Participatory evaluation: Visualizing quantitative data with Excel<\/span><\/h4><p class=\"c99\"><span class=\"c1\">You can use PAR for collaboratively exploring quantitative data. \u00a0Once data has been collected and the results have been generated, community members and other members of the evaluation team can provide valuable input in helping make sense of evaluation findings. As the team reviews data, you can create printouts or slides of pie charts, bar graphs, and other visual representations of data. Evaluators share data, guiding the discussion with program staff and other stakeholders. Questions to guide discussion may include the following:<\/span><\/p><ul class=\"c5 lst-kix_ai2pkual9k5g-0 start\"><li class=\"c12 li-bullet-0\"><span class=\"c1\">Is there anything that surprises you about the data?<\/span><\/li><li class=\"c12 li-bullet-0\"><span class=\"c1\">Why do you think we are seeing these (differences\/similarities) in responses?<\/span><\/li><li class=\"c12 li-bullet-0\"><span class=\"c1\">How would you explain this finding?<\/span><\/li><li class=\"c12 li-bullet-0\"><span class=\"c1\">What recommendations would you make for our program\/organization based on these findings?<\/span><\/li><\/ul>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-53873da elementor-section-boxed elementor-section-height-default elementor-section-height-default tf-sticky-section tf-sticky-no\" data-id=\"53873da\" data-element_type=\"section\" data-e-type=\"section\" data-settings=\"{&quot;tf_sticky&quot;:&quot;no&quot;}\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-4c0a68f\" data-id=\"4c0a68f\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<section class=\"elementor-section elementor-inner-section elementor-element elementor-element-4d0546d elementor-section-boxed elementor-section-height-default elementor-section-height-default tf-sticky-section tf-sticky-no\" data-id=\"4d0546d\" data-element_type=\"section\" data-e-type=\"section\" data-settings=\"{&quot;tf_sticky&quot;:&quot;no&quot;}\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-50 elementor-inner-column elementor-element elementor-element-26fb874\" data-id=\"26fb874\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-4b8e9e8 elementor-align-left view-more-post elementor-widget elementor-widget-button\" data-id=\"4b8e9e8\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"button.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<div class=\"elementor-button-wrapper\">\n\t\t\t\t\t<a class=\"elementor-button elementor-button-link elementor-size-sm\" href=\"https:\/\/esperanzaunited.org\/es\/knowledge-base\/construccion-de-evidencia\/como-puedo-correr-la-voz\/\">\n\t\t\t\t\t\t<span class=\"elementor-button-content-wrapper\">\n\t\t\t\t\t\t<span class=\"elementor-button-icon\">\n\t\t\t\t<i aria-hidden=\"true\" class=\"fas fa-chevron-right\"><\/i>\t\t\t<\/span>\n\t\t\t\t\t\t\t\t<\/span>\n\t\t\t\t\t<\/a>\n\t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t<div class=\"elementor-column elementor-col-50 elementor-inner-column elementor-element elementor-element-e0c199f\" data-id=\"e0c199f\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-ff9bb11 elementor-widget elementor-widget-text-editor\" data-id=\"ff9bb11\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p><span class=\"c26 c19\">See <a href=\"https:\/\/datavizhub.wordpress.com\/2014\/05\/14\/data-visualization-approaches-for-program-evaluation-and-beyond\/\">Data Visualization Approaches<\/a> website link for more information.<\/span><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-bf5693b elementor-section-boxed elementor-section-height-default elementor-section-height-default tf-sticky-section tf-sticky-no\" data-id=\"bf5693b\" data-element_type=\"section\" data-e-type=\"section\" data-settings=\"{&quot;tf_sticky&quot;:&quot;no&quot;}\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-b8b823a\" data-id=\"b8b823a\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<section class=\"elementor-section elementor-inner-section elementor-element elementor-element-8766830 elementor-section-boxed elementor-section-height-default elementor-section-height-default tf-sticky-section tf-sticky-no\" data-id=\"8766830\" data-element_type=\"section\" data-e-type=\"section\" data-settings=\"{&quot;tf_sticky&quot;:&quot;no&quot;}\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-50 elementor-inner-column elementor-element elementor-element-fe54e58\" data-id=\"fe54e58\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-b490259 elementor-align-left view-more-post elementor-widget elementor-widget-button\" data-id=\"b490259\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"button.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<div class=\"elementor-button-wrapper\">\n\t\t\t\t\t<a class=\"elementor-button elementor-button-link elementor-size-sm\" href=\"https:\/\/ogsite.kinsta.cloud\/en\/knowledge-base\/building-evidence\/how-do-i-spread-the-word\/\">\n\t\t\t\t\t\t<span class=\"elementor-button-content-wrapper\">\n\t\t\t\t\t\t<span class=\"elementor-button-icon\">\n\t\t\t\t<i aria-hidden=\"true\" class=\"fas fa-chevron-right\"><\/i>\t\t\t<\/span>\n\t\t\t\t\t\t\t\t<\/span>\n\t\t\t\t\t<\/a>\n\t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t<div class=\"elementor-column elementor-col-50 elementor-inner-column elementor-element elementor-element-f610d17\" data-id=\"f610d17\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-b27da3e elementor-widget elementor-widget-text-editor\" data-id=\"b27da3e\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p><span class=\"c26 c19\">For sharing your work, see page\u00a0<\/span><span class=\"c11\"><a class=\"c3\" href=\"https:\/\/esperanzaunited.org\/en\/knowledge-base\/building-evidence\/how-do-i-spread-the-word\/\">How do I spread the word<\/a><\/span><span class=\"c1\">.<\/span><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-3f00165 elementor-section-boxed elementor-section-height-default elementor-section-height-default tf-sticky-section tf-sticky-no\" data-id=\"3f00165\" data-element_type=\"section\" data-e-type=\"section\" data-settings=\"{&quot;tf_sticky&quot;:&quot;no&quot;}\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-a3070bc\" data-id=\"a3070bc\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-b1e3257 elementor-widget elementor-widget-text-editor\" data-id=\"b1e3257\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<div><\/div>\n<div style=\"text-align: right;\"><span style=\"font-weight: 200;\">Last updated 2021<\/span><\/div>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"<p>Developing questions Consider inviting community members to contribute to the model development. Think about a logic model as a \u201cliving\u201d document, flexible, open to different perspectives, and changing as the program grows and changes too. Logic model discussions can help spur evaluation questions about the process, activities, or outcomes of programs. [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":17871,"template":"","meta":{"_cbd_carousel_blocks":"[]"},"media_category":[146,228,233],"media_tags":[272,282,266,278,313,283,302,284],"class_list":["post-9158","cde-knowledge-base","type-cde-knowledge-base","status-publish","has-post-thumbnail","hentry","media_category-esperanza-united-departments","media_category-toolkits","media_category-building-evidence","media_tags-capacity-building","media_tags-documentation-and-evaluation","media_tags-free","media_tags-research-and-evaluation","media_tags-service-provider","media_tags-service-providers","media_tags-toolkit","media_tags-toolkits"],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/esperanzaunited.org\/en\/wp-json\/wp\/v2\/cde-knowledge-base\/9158","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/esperanzaunited.org\/en\/wp-json\/wp\/v2\/cde-knowledge-base"}],"about":[{"href":"https:\/\/esperanzaunited.org\/en\/wp-json\/wp\/v2\/types\/cde-knowledge-base"}],"author":[{"embeddable":true,"href":"https:\/\/esperanzaunited.org\/en\/wp-json\/wp\/v2\/users\/2"}],"version-history":[{"count":26,"href":"https:\/\/esperanzaunited.org\/en\/wp-json\/wp\/v2\/cde-knowledge-base\/9158\/revisions"}],"predecessor-version":[{"id":37682,"href":"https:\/\/esperanzaunited.org\/en\/wp-json\/wp\/v2\/cde-knowledge-base\/9158\/revisions\/37682"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/esperanzaunited.org\/en\/wp-json\/wp\/v2\/media\/17871"}],"wp:attachment":[{"href":"https:\/\/esperanzaunited.org\/en\/wp-json\/wp\/v2\/media?parent=9158"}],"wp:term":[{"taxonomy":"media_category","embeddable":true,"href":"https:\/\/esperanzaunited.org\/en\/wp-json\/wp\/v2\/media_category?post=9158"},{"taxonomy":"media_tags","embeddable":true,"href":"https:\/\/esperanzaunited.org\/en\/wp-json\/wp\/v2\/media_tags?post=9158"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}