Day 71: The Result That Wouldn't Replicate

Dialogue

♪ Audio recordings are on the way. For now, each lesson is the dialogue with its English translation.

Keys: E hide English · ← → previous / next day

1. 1

   A 교수님, 시간 내 주셔서 감사합니다. 저희가 지난 학기부터 하던 재현 실험 결과가 나와서, 먼저 말씀드려야 할 것 같아서요.

   Gyosunim, sigan nae jusyeoseo gamsahamnida. Jeohuiga jinan hakgibuteo hadeon jaehyeon silheom gyeolgwaga nawaseo, meonjeo malsseumdeuryeoya hal geot gataseoyo.

   Professor, thank you for making time. The results of the replication study we've been running since last semester are in, and we thought we should tell you first.

   Line 1
2. 2

   C 네, 앉아요. 둘 다 표정을 보니 결과가 예상이랑 다르게 나왔나 봐요.

   Ne, anjayo. Dul da pyojeongeul boni gyeolgwaga yesangirang dareuge nawanna bwayo.

   Sure, have a seat. From the look on your faces, the results didn't come out as expected.

   Line 2
3. 3

   B 네... 따뜻한 컵을 쥐고 있으면 다른 사람을 더 따뜻한 사람으로 본다는 그 실험 있잖아요. 표본을 세 배로 늘려서 해 봤는데, 효과가 거의 안 나왔어요.

   Ne... ttatteutan keobeul jwigo isseumyeon dareun sarameul deo ttatteutan sarameuro bondaneun geu silheom itjanayo. Pyoboneul se baero neullyeoseo hae bwanneunde, hyogwaga geoui an nawasseoyo.

   Yes... You know the experiment where holding a warm cup makes people see others as warmer people? We ran it with a sample three times as big, and the effect barely showed up.

   Line 3
4. 4

   C 한정호 교수님 논문이요? 그분이 내 지도 교수님이셨던 건 알죠?

   Hanjeongho gyosunim nonmuniyo? Geubuni nae jido gyosunimisyeotdeon geon aljyo?

   Professor Han Jeongho's paper? You know he was my doctoral supervisor, right?

   Line 4
5. 5

   A 네, 알아요. 그래서 더 조심스러웠어요. 저희 데이터 모은다고 방학 내내 실험실에서 살다시피 했어요. 참가자만 삼백 명이 넘어요.

   Ne, arayo. Geuraeseo deo josimseureowosseoyo. Jeohui deiteo moeundago banghak naenae silheomsireseo saldasipi haesseoyo. Chamgajaman sambaek myeongi neomeoyo.

   Yes, we know. That's why we were extra careful. We practically lived in the lab all vacation collecting data. Over three hundred participants.

   Line 5
6. 6

   B 민재야, 사전 등록 얘기도 해. 교수님, 분석 계획도 실험 전에 미리 등록해 뒀어요. 나중에 결과 보고 끼워 맞췄다는 말 안 나오게요.

   Minjaeya, sajeon deungnok yaegido hae. Gyosunim, bunseok gyehoekdo silheom jeone miri deungnokae dwosseoyo. Najunge gyeolgwa bogo kkiwo matchwotdaneun mal an naogeyo.

   Minjae, tell her about the pre-registration too. Professor, we registered our analysis plan before running the study. So nobody can say we bent the analysis to fit the results.

   Line 6
7. 7

   C 사전 등록까지 했으면 절차는 문제없겠네요. 그래도 원래 논문이랑 다른 점은 없었어요? 컵 온도라든가, 참가자 나이라든가.

   Sajeon deungnokkkaji haesseumyeon jeolchaneun munjeeopgenneyo. Geuraedo wollae nonmunirang dareun jeomeun eopseosseoyo? Keop ondoradeunga, chamgaja nairadeunga.

   If you pre-registered, the procedure should be sound. But was anything different from the original? The cup temperature, say, or the participants' ages.

   Line 7
8. 8

   A 컵 온도는 논문에 적힌 대로 맞췄어요. 참가자도 원래 논문처럼 대학생이었고요.

   Keop ondoneun nonmune jeokin daero matchwosseoyo. Chamgajado wollae nonmuncheoreom daehaksaengieotgoyo.

   We matched the cup temperature to what the paper says. And our participants were college students, like in the original.

   Line 8
9. 9

   B 그리고 그것도 말씀드려야지. 우리 분석 두 번 한 거.

   Geurigo geugeotdo malsseumdeuryeoyaji. Uri bunseok du beon han geo.

   And you have to tell her the other thing. How we ran the analysis twice.

   Line 9
10. 10

    A 아, 네. 혹시 저희 실수일까 봐 하은이가 분석을 처음부터 따로 다시 해 봤어요. 결과는 똑같았어요.

    A, ne. Hoksi jeohui silsuilkka bwa haeuniga bunseogeul cheoeumbuteo ttaro dasi hae bwasseoyo. Gyeolgwaneun ttokgatasseoyo.

    Oh, right. In case we'd made a mistake, Haeun redid the whole analysis separately from scratch. Same result.

    Line 10
11. 11

    C 하아... 솔직히 말할게요. 사실 나도 박사 과정 때 이 실험을 한 번 해 봤어요. 그때도 효과가 안 나왔어요.

    Haa... soljiki malhalgeyo. Sasil nado baksa gwajeong ttae i silheomeul han beon hae bwasseoyo. Geuttaedo hyogwaga an nawasseoyo.

    Well... Let me be honest. I actually ran this experiment myself once, as a PhD student. The effect didn't show up then either.

    Line 11
12. 12

    B 네? 그런데 왜 발표 안 하셨어요?

    Ne? Geureonde wae balpyo an hasyeosseoyo?

    Sorry? Then why didn't you publish it?

    Line 12
13. 13

    C 내 설계에 결함이 있어서라고 생각했죠. 은사님 논문을 반박하겠다고 나서기엔 너무 어리기도 했고요. 지금 생각하면 부끄러운 일이에요.

    Nae seolgyee gyeolhami isseoseorago saenggakaetjyo. Eunsanim nonmuneul banbakagetdago naseogien neomu eorigido haetgoyo. Jigeum saenggakamyeon bukkeureoun irieyo.

    I assumed my design was flawed. And I was too young to go around challenging my own mentor's paper. Looking back, I'm not proud of it.

    Line 13
14. 14

    A 그럼 저희 결과는 어떻게 할까요? 학회에 내면 한 교수님 쪽에서 반론이 나올 것 같아서요.

    Geureom jeohui gyeolgwaneun eotteoke halkkayo? Hakhoee naemyeon han gyosunim jjogeseo balloni naol geot gataseoyo.

    So what should we do with our results? If we submit them to a conference, we expect pushback from Professor Han's side.

    Line 14
15. 15

    C 내야지요. 대신 하나만 약속해요. 심사자가 반론을 제기하거들랑 감정적으로 대응하지 말고 데이터로만 답하세요.

    Naeyajiyo. Daesin hanaman yaksokaeyo. Simsajaga balloneul jegihageodeullang gamjeongjeogeuro daeeunghaji malgo deiteoroman dapaseyo.

    You submit them. But promise me one thing. If a reviewer raises objections, don't respond emotionally. Answer with data, and nothing else.

    Line 15
16. 16

    B 들었지? 너 댓글 싸움하듯이 답장 쓰면 안 돼.

    Deureotji? Neo daetgeul ssaumhadeusi dapjang sseumyeon an dwae.

    Hear that? No writing replies like you're in a comment-section fight.

    Line 16
17. 17

    A 내가 언제 그랬어. 교수님, 한 교수님께는 미리 알려 드려야 하지 않을까요?

    Naega eonje geuraesseo. Gyosunim, han gyosunimkkeneun miri allyeo deuryeoya haji aneulkkayo?

    When have I ever done that? Professor, shouldn't we let Professor Han know in advance?

    Line 17
18. 18

    C 그건 내가 할게요. 원자료랑 분석 코드를 먼저 보내 드리고 직접 검증해 달라고 부탁드리는 게 예의일 거예요.

    Geugeon naega halgeyo. Wonjaryorang bunseok kodeureul meonjeo bonae deurigo jikjeop geomjeunghae dallago butakdeurineun ge yeuiil geoyeyo.

    I'll do that. The courteous thing is to send him the raw data and analysis code first and ask him to check them himself.

    Line 18
19. 19

    B 혹시 그러면 교수님 입장이 난처해지시는 거 아니에요?

    Hoksi geureomyeon gyosunim ipjangi nancheohaejisineun geo anieyo?

    Won't that put you in an awkward position?

    Line 19
20. 20

    C 난처하죠. 그래도 제자들 논문을 막는다고 은사님을 지켜 드리는 건 아니잖아요. 한 교수님도 그런 걸 원하실 분이 아니고요.

    Nancheohajyo. Geuraedo jejadeul nonmuneul mangneundago eunsanimeul jikyeo deurineun geon anijanayo. Han gyosunimdo geureon geol wonhasil buni anigoyo.

    It will. But blocking my own students' paper isn't the way to protect my mentor. And he's not the kind of man who'd want that.

    Line 20
21. 21

    A 그럼 결과 부분 초안을 다음 주까지 정리해서 드릴게요.

    Geureom gyeolgwa bubun choaneul daeum jukkaji jeongnihaeseo deurilgeyo.

    Then we'll write up a draft of the results section and give it to you by next week.

    Line 21
22. 22

    C 좋아요. 그리고 제목에서 '실패'라는 말은 빼요. 재현이 안 된 것도 결과예요. 그걸 확인하려고 두 사람이 방학을 다 쓴 거고요.

    Joayo. Geurigo jemogeseo 'silpae'raneun mareun ppaeyo. Jaehyeoni an doen geotdo gyeolgwayeyo. Geugeol hwaginharyeogo du sarami banghageul da sseun geogoyo.

    Good. And take the word 'failure' out of the title. A result that doesn't replicate is still a result. That's what you two gave up your whole break to find out.

    Line 22