Jump to content

Success in research: Difference between revisions

From IdeaWazaWiki
Lumo (talk | contribs)
m Lumo moved page Comparing amateur and professional research to Success in research over redirect: Restore the broad title for the revised article on research success
Lumo (talk | contribs)
Make the steps for a successful research project easier to follow and add relevant wiki links
Line 1: Line 1:
Success in [[Research|research]] starts with asking a question that evidence can answer. A useful result tells readers what was found, how it was checked, and where uncertainty remains. A project can succeed by documenting a little-known event, producing a reliable dataset, or discovering that a widely held explanation fits the evidence poorly.
Success in [[Research|research]] means finding something useful and showing how you found it. You might establish when an event happened, collect observations that others can use, or narrow down which explanations fit the evidence. A small answer with clear evidence can give the next person a place to start.


== Who does research? ==
Suppose you want to know why one street seems to flood more often. Start by finding out which floods you can document. A timeline gives you something to compare with rainfall records or changes to the storm drains.


An '''independent researcher''' pursues a project outside an institutional research appointment. They may work alone or with collaborators and may have years of training or practical experience. Someone who publishes local history videos, for example, may know the area's maps and archives well enough to notice that a frequently repeated story gives the wrong date for a flood. Sharing the relevant records lets a viewer check the claim.
== Choose a question you can answer ==


In '''citizen science''', members of the public take part voluntarily in scientific research. They may help choose the question, gather observations, interpret results, or lead a project. '''Professional researchers''' do research as part of their paid work. These roles can overlap. An independent researcher can contribute to a citizen science project, and a professional in one field can volunteer in another. [https://www.noaa.gov/office-education/citizen-science NOAA's introduction to citizen science]
A good [[Research question|research question]] gives you a way to start looking for evidence. For the flooding project, choose one street, a range of years, and a definition of flooding. Do you mean water over the curb, water entering homes, or either? The definition affects which accounts belong in your timeline.


== What helps research succeed? ==
Make three decisions before you start.


* '''Ask a question you can answer.''' If you want to date a flood, decide whether you mean when water first entered the streets or when it reached its highest point. Look for records that can distinguish the two. In a larger project, make sure everyone gathering observations uses the same definitions.
# '''Where to look.''' Pick sources you can get to, such as digitized newspapers, dated photographs, or city records.
* '''Leave a record of the evidence and decisions.''' Record where each observation came from and how you handled conflicting accounts. If you use a spreadsheet or code, keep the original data and explain the steps that produced your results. When working with others, agree on who will check the records and how contributors will be credited.
# '''What to make.''' Choose something you can finish and share. A table with one row per flood, a date, and a source is enough to get started.
* '''Check the result independently.''' Ask someone to trace a sample of claims back to the evidence. They may find that two newspaper stories drew on the same report, so both repeat the same date. Compare the accounts with a dated photograph or another source that could confirm or challenge them. Explain which parts remain uncertain.
# '''When to review.''' Set aside an hour to check how the search is going. If the newspaper archive has too many gaps, shorten the period or try city records. Write down what changed and why.


== What Galaxy Zoo shows ==
== Keep a record as you go ==


In the original Galaxy Zoo project, members of the public classified images from the Sloan Digital Sky Survey. The team combined multiple judgments and checked its results against classifications by professional astronomers for subsets of the galaxies. The two sets of classifications were broadly consistent for the simple galaxy shapes the project studied. Together, the contributors produced a catalog that other researchers could use. [https://arxiv.org/abs/0804.4483 Lintott and colleagues, Galaxy Zoo]
Use a [[Research log|research log]] to save search terms, dates, page numbers, links, and notes on what you found. For a flood photo, record where you found it, who supplied the date, and how you recognized the street. A folder of photos and clippings is easier to use when each item has a note that ties it to a claim. This also makes [[Citing sources|citing your sources]] easier when you write.


A vote can help identify images that need another look. Reviewers should also check some of the images on which almost everyone agrees. If most people read the same blurry spiral galaxy as elliptical, high agreement can hide a shared error.
== Check the most important claim ==


== How could we compare different approaches? ==
Start with the claim your answer depends on. If two newspapers give the same date, see whether one copied the other's account or whether both drew on the same report. Look for a separate piece of evidence, such as a dated photograph or a road closure notice. Ask someone else to trace one or two entries from your timeline back to the original records. A fresh reader may catch a date you copied incorrectly or a location you assumed was obvious.


When can a large group with little formal training produce more useful or original results than a small team of specialists? Start with a task you can measure. Ask volunteer, professional, and mixed teams to mark features in the same set of public images. Give them the same tools, instructions, and practice examples. Record relevant experience alongside formal education.
Then state what the evidence supports. If you found three floods in the 1960s, give their dates and sources. If the archive is missing several years, say which ones and leave open how often the street flooded. Share the timeline and enough of your method for someone else to check or extend it. This is one way to put [[Open research|open research]] into practice.


Decide what counts as success before seeing the results. Count the features each team finds correctly, misses, or marks by mistake. Have reviewers check a sample against an independently prepared reference without knowing which team produced it. If the project is looking for novel findings, track which leads survive follow-up. It can take years to tell whether a result changes a field.
== When working with others helps ==


Give teams equal work hours if you want to compare how they perform with the same amount of time. If you want to compare what each approach achieves within a budget, let team sizes vary and record training, coordination, and checking costs, along with unpaid hours. Repeat the study with different teams and images to see how far the result holds.
Independent researchers pursue a project outside an institutional research appointment. They may bring years of experience to it. In '''citizen science''', members of the public volunteer to take part in scientific research. Professional researchers do research as part of their paid work. The same project can draw on all three. In a local flood study, one person might trace old street names, others might read newspapers, and someone with mapping experience might check where each flood happened. [https://www.noaa.gov/office-education/citizen-science NOAA's introduction to citizen science]


For a classroom version, have students label a set of public images independently. Compare individual labels and the group vote with reference labels prepared ahead of time. Find one case where voting helped and one where the group would benefit from reviewing the image together.
One example from astronomy is '''Galaxy Zoo'''. Volunteers looked at telescope images and identified galaxy shapes. Several volunteers examined each image. The team combined their judgments and checked a sample against classifications by professional astronomers. [https://arxiv.org/abs/0804.4483 The original Galaxy Zoo study]
 
== Try a small comparison ==
 
Could a group with little formal training produce a more useful result than a smaller, experienced team? Give both groups the same set of newspaper pages and ask them to find flood reports. Record the time they spend, including training and checking. Ask a third group to score the entries without knowing which team made them. Count well-supported entries, missed reports, and duplicates. If you want to see whether experience or group size accounts for a difference, repeat the task while changing one of those factors at a time.


==Discussion questions, essay ideas, and learning related AI prompt ideas==
==Discussion questions, essay ideas, and learning related AI prompt ideas==


* What could make an independently produced local history video more useful to a researcher than a published summary of the same event?
* What would convince you that flooding became more frequent if newspaper coverage also increased?
* Write an essay about how you would divide the work of studying a local stream among residents, independent researchers, and a laboratory team. Explain who would choose the question and how each group would check the others' findings.
* Write a short essay about a project you could do independently and one that would benefit from a group. Explain how you would check the most important claim in each project.
* Ask an AI tool to design a fair comparison of volunteer and professional teams on a public dataset. Have it specify the outcome and what to do with ambiguous cases. Exchange plans and see whether two readers can score the same example consistently.
* Give an AI tool a draft research question and ask it to suggest records to look for and a way to check the findings. Look up two of the suggested sources yourself and see whether they contain the information the tool expects.


==Readings from Wikipedia==
==Readings from Wikipedia==
Line 43: Line 47:
== Research readings ==
== Research readings ==


* [https://www.nationalacademies.org/read/25303/chapter/3 National Academies, Reproducibility and Replicability in Science]. The summary explains how researchers check an original analysis and repeat a study with new data.
* [https://www.nationalacademies.org/read/25303/chapter/3 National Academies, Reproducibility and Replicability in Science]. See the summary for ways to check an analysis and repeat a study with new data.


== See also ==
== See also ==

Revision as of 22:12, 22 November 2026

Success in research means finding something useful and showing how you found it. You might establish when an event happened, collect observations that others can use, or narrow down which explanations fit the evidence. A small answer with clear evidence can give the next person a place to start.

Suppose you want to know why one street seems to flood more often. Start by finding out which floods you can document. A timeline gives you something to compare with rainfall records or changes to the storm drains.

Choose a question you can answer

A good research question gives you a way to start looking for evidence. For the flooding project, choose one street, a range of years, and a definition of flooding. Do you mean water over the curb, water entering homes, or either? The definition affects which accounts belong in your timeline.

Make three decisions before you start.

  1. Where to look. Pick sources you can get to, such as digitized newspapers, dated photographs, or city records.
  2. What to make. Choose something you can finish and share. A table with one row per flood, a date, and a source is enough to get started.
  3. When to review. Set aside an hour to check how the search is going. If the newspaper archive has too many gaps, shorten the period or try city records. Write down what changed and why.

Keep a record as you go

Use a research log to save search terms, dates, page numbers, links, and notes on what you found. For a flood photo, record where you found it, who supplied the date, and how you recognized the street. A folder of photos and clippings is easier to use when each item has a note that ties it to a claim. This also makes citing your sources easier when you write.

Check the most important claim

Start with the claim your answer depends on. If two newspapers give the same date, see whether one copied the other's account or whether both drew on the same report. Look for a separate piece of evidence, such as a dated photograph or a road closure notice. Ask someone else to trace one or two entries from your timeline back to the original records. A fresh reader may catch a date you copied incorrectly or a location you assumed was obvious.

Then state what the evidence supports. If you found three floods in the 1960s, give their dates and sources. If the archive is missing several years, say which ones and leave open how often the street flooded. Share the timeline and enough of your method for someone else to check or extend it. This is one way to put open research into practice.

When working with others helps

Independent researchers pursue a project outside an institutional research appointment. They may bring years of experience to it. In citizen science, members of the public volunteer to take part in scientific research. Professional researchers do research as part of their paid work. The same project can draw on all three. In a local flood study, one person might trace old street names, others might read newspapers, and someone with mapping experience might check where each flood happened. NOAA's introduction to citizen science

One example from astronomy is Galaxy Zoo. Volunteers looked at telescope images and identified galaxy shapes. Several volunteers examined each image. The team combined their judgments and checked a sample against classifications by professional astronomers. The original Galaxy Zoo study

Try a small comparison

Could a group with little formal training produce a more useful result than a smaller, experienced team? Give both groups the same set of newspaper pages and ask them to find flood reports. Record the time they spend, including training and checking. Ask a third group to score the entries without knowing which team made them. Count well-supported entries, missed reports, and duplicates. If you want to see whether experience or group size accounts for a difference, repeat the task while changing one of those factors at a time.

  • What would convince you that flooding became more frequent if newspaper coverage also increased?
  • Write a short essay about a project you could do independently and one that would benefit from a group. Explain how you would check the most important claim in each project.
  • Give an AI tool a draft research question and ask it to suggest records to look for and a way to check the findings. Look up two of the suggested sources yourself and see whether they contain the information the tool expects.

Readings from Wikipedia

Research readings

See also