Marginally Significant

Twitter post: https://twitter.com/wgervais/status/1251319948581892096?s=20 Baumeister paper: https://www.sciencedirect.com/science/article/abs/pii/S002210311600007X Marginally Significant is hosted by: Andrew Smith @andrewrsmith (https://twitter.com/AndrewRSmith) Twila Wingrove @twilawingrove (https://twitter.com/TwilaWingrove) Andrew Monroe @monroeandrew (https://twitter.com/MonroeAndrew) Chris Holden @profcjholden (https://twitter.com/profcjholden) You can contact Marginally Significant on Twitter (@marginallysig (https://twitter.com/MarginallySig)), through email (marginallysig@gmail.com), or on the web (marginallysignificant.fireside.fm/contact (https://marginallysignificant.fireside.fm/contact)).

Marginally Significant is hosted by: Andrew Smith @andrewrsmith (https://twitter.com/AndrewRSmith) Twila Wingrove @twilawingrove (https://twitter.com/TwilaWingrove) Andrew Monroe @monroeandrew (https://twitter.com/MonroeAndrew) Chris Holden @profcjholden (https://twitter.com/profcjholden) You can contact Marginally Significant on Twitter (@marginallysig (https://twitter.com/MarginallySig)), through email (marginallysig@gmail.com), or on the web (marginallysignificant.fireside.fm/contact (https://marginallysignificant.fireside.fm/contact)).

Do you have a file drawer? Cleaning out the file drawer is an idea that has been floating around on twitter, but is it feasible? What does it mean for past studies? Is there a way in which we could get a sense of how many studies are in file drawers? Also, we discuss writing letters of recommendation and how we evaluate the ones we read. Marginally Significant is hosted by: Andrew Smith @andrewrsmith (https://twitter.com/AndrewRSmith) Twila Wingrove @twilawingrove (https://twitter.com/TwilaWingrove) Andrew Monroe @monroeandrew (https://twitter.com/MonroeAndrew) Chris Holden @profcjholden (https://twitter.com/profcjholden) You can contact Marginally Significant on Twitter (@marginallysig (https://twitter.com/MarginallySig)), through email (marginallysig@gmail.com), or on the web (marginallysignificant.fireside.fm/contact (https://marginallysignificant.fireside.fm/contact)).

Are you on the academic job market? In this episode, we discuss our experiences being on the market, tips for success at a wide variety of universities, and our thoughts now that we've been on hiring committees. Most people won't be hired at an R1 university. Understanding what other types of universities are looking for can increase the likelihood of getting an academic job. Marginally Significant is hosted by: Andrew Smith @andrewrsmith (https://twitter.com/AndrewRSmith) Twila Wingrove @twilawingrove (https://twitter.com/TwilaWingrove) Andrew Monroe @monroeandrew (https://twitter.com/MonroeAndrew) Chris Holden @profcjholden (https://twitter.com/profcjholden) You can contact Marginally Significant on Twitter (@marginallysig (https://twitter.com/MarginallySig)), through email (marginallysig@gmail.com), or on the web (marginallysignificant.fireside.fm/contact (https://marginallysignificant.fireside.fm/contact)).

We are required to judge people, whether it is students applying for graduate programs or faculty members going up for tenure. A number of graduate programs have dropped the GRE as a requirement for applications. Many of these programs cite potential biases in the GRE as a reason for removing the requirement. Proponents of the GRE state that, while possibly biased, the GRE is likely to be less biased than alternatives (e.g., letters of recommendation, personal statements). Another biased evaluation is student evaluations of teaching. Numerous studies have shown that they are affected by the teacher's gender and race, but can there still be value in the evaluations? In this episode we discuss whether these biased evaluations should still be used. Marginally Significant is hosted by: Andrew Smith @andrewrsmith (https://twitter.com/AndrewRSmith) Twila Wingrove @twilawingrove (https://twitter.com/TwilaWingrove) Andrew Monroe @monroeandrew (https://twitter.com/MonroeAndrew) Chris Holden @profcjholden (https://twitter.com/profcjholden) You can contact Marginally Significant on Twitter (@marginallysig (https://twitter.com/MarginallySig)), through email (marginallysig@gmail.com), or on the web (marginallysignificant.fireside.fm/contact (https://marginallysignificant.fireside.fm/contact)).

Is it worth the time and effort to apply for grants when only a small percentage are funded? A recent paper by Kevin Gross and Carl Bergstrom (2019) suggests grant competitions in their corrent form are not worth it. We weigh in on our thoughts about the paper as well as grant funding, in general. We also briefly talk about the aspect of our jobs that motivate us to keep working. Spoiler alert: it is not applying for grants. Marginally Significant is hosted by: Andrew Smith @andrewrsmith (https://twitter.com/AndrewRSmith) Twila Wingrove @twilawingrove (https://twitter.com/TwilaWingrove) Andrew Monroe @monroeandrew (https://twitter.com/MonroeAndrew) Chris Holden @profcjholden (https://twitter.com/profcjholden) You can contact Marginally Significant on Twitter (@marginallysig (https://twitter.com/MarginallySig)), through email (marginallysig@gmail.com), or on the web (marginallysignificant.fireside.fm/contact (https://marginallysignificant.fireside.fm/contact)).

Is open science open to everyone? Are there potential costs to engaging in open science practices? Should diversity be a core value of open science? In this episode we attempt to tackle these potentially polarizing questions. Marginally Significant is hosted by: Andrew Smith @andrewrsmith (https://twitter.com/AndrewRSmith) Twila Wingrove @twilawingrove (https://twitter.com/TwilaWingrove) Andrew Monroe @monroeandrew (https://twitter.com/MonroeAndrew) Chris Holden @profcjholden (https://twitter.com/profcjholden) You can contact Marginally Significant on Twitter (@marginallysig (https://twitter.com/MarginallySig)), through email (marginallysig@gmail.com), or on the web (marginallysignificant.fireside.fm/contact (https://marginallysignificant.fireside.fm/contact)).

The call to use larger sample sizes in psychological research has been around for decades, but only relatively recently have researchers substantially increased the number of people in their studies. Although this change is certainly a good thing, it is quite possible that the emphasis on large sample sizes impacts certainly people (e.g., researchers with limited funding and access to no or small participant pools) and research areas (e.g., programs of research aimed at hard-to-recruit samples) more than others. In this episode, we discuss whether this is an issue for the field. We also talk about whether we've gone far enough to increase the sample sizes in our research. Marginally Significant is hosted by: Andrew Smith @andrewrsmith (https://twitter.com/AndrewRSmith) Twila Wingrove @twilawingrove (https://twitter.com/TwilaWingrove) Andrew Monroe @monroeandrew (https://twitter.com/MonroeAndrew) Chris Holden @profcjholden (https://twitter.com/profcjholden) You can contact Marginally Significant on Twitter (@marginallysig (https://twitter.com/MarginallySig)), through email (marginallysig@gmail.com), or on the web (marginallysignificant.fireside.fm/contact (https://marginallysignificant.fireside.fm/contact)).

Most academics go to conferences, but who are they good for? Are there disparities in who can attend and who benefits from conferences? In this episode, we talk about one potential factor contributing to disparities--differences in travel funding available at different universities. We also talk about our own experiences with what we've gotten out of conferences with respect to our research, teaching, and mentoring of students. Marginally Significant is hosted by: Andrew Smith @andrewrsmith (https://twitter.com/AndrewRSmith) Twila Wingrove @twilawingrove (https://twitter.com/TwilaWingrove) Andrew Monroe @monroeandrew (https://twitter.com/MonroeAndrew) Chris Holden @profcjholden (https://twitter.com/profcjholden) You can contact Marginally Significant on Twitter (@marginallysig (https://twitter.com/MarginallySig)), through email (marginallysig@gmail.com), or on the web (marginallysignificant.fireside.fm/contact (https://marginallysignificant.fireside.fm/contact)).

Collaborations are the norm, but can sometimes be a challenge. In this episode, we discuss issues we've had and ways we've dealt with collaborating with faculty members, students, and previous advisors. Marginally Significant is hosted by: Andrew Smith @andrewrsmith (https://twitter.com/AndrewRSmith) Twila Wingrove @twilawingrove (https://twitter.com/TwilaWingrove) Andrew Monroe @monroeandrew (https://twitter.com/MonroeAndrew) Chris Holden @profcjholden (https://twitter.com/profcjholden) You can contact Marginally Significant on Twitter (@marginallysig (https://twitter.com/MarginallySig)), through email (marginallysig@gmail.com), or on the web (marginallysignificant.fireside.fm/contact (https://marginallysignificant.fireside.fm/contact)).

As professors, we often serve in many different roles: teacher, researcher, mentor, administrator, program director. With so many jobs, how do we define ourselves? With which role do we most identify? In this episode, we talk about our academic identities, how they have changed over time, and how our identities might shape other people's perceptions of us. Marginally Significant is hosted by: Andrew Smith @andrewrsmith (https://twitter.com/AndrewRSmith) Twila Wingrove @twilawingrove (https://twitter.com/TwilaWingrove) Andrew Monroe @monroeandrew (https://twitter.com/MonroeAndrew) Chris Holden @profcjholden (https://twitter.com/profcjholden) You can contact Marginally Significant on Twitter (@marginallysig (https://twitter.com/MarginallySig)), through email (marginallysig@gmail.com), or on the web (marginallysignificant.fireside.fm/contact (https://marginallysignificant.fireside.fm/contact)).

How do we mentor and train graduate students so we don't simply churn out intellectual clones? How do we help students with mental health issues? Should we set up a Kobayashi Maru (https://en.wikipedia.org/wiki/Kobayashi_Maru) for our students? In this episode, we talk about our experienes and philosophies with mentoring students. Marginally Significant is hosted by: Andrew Smith @andrewrsmith (https://twitter.com/AndrewRSmith) Twila Wingrove @twilawingrove (https://twitter.com/TwilaWingrove) Andrew Monroe @monroeandrew (https://twitter.com/MonroeAndrew) Chris Holden @profcjholden (https://twitter.com/profcjholden) You can contact Marginally Significant on Twitter (@marginallysig (https://twitter.com/MarginallySig)), through email (marginallysig@gmail.com), or on the web (marginallysignificant.fireside.fm/contact (https://marginallysignificant.fireside.fm/contact)).

Research designs and the required statistical analyses are getting more and more complicated. It is becoming increasingly common for researchers to consult with statisticians to analyze their data. This can create an issue where the lead researcher on a project does not know how to run the analysis they describe in their papers and presentations. In this episode we discuss whether the lead researcher has an obligation to know how to run, interpret, and describe the analyses in their research projects. Smith raises concerns and potential issues with relying on someone to run the analyses without being able to double check for accuracy. Wingrove and Holden argue that we should trust the statisticians to do their job. Marginally Significant is hosted by: Andrew Smith @andrewrsmith (https://twitter.com/AndrewRSmith) Twila Wingrove @twilawingrove (https://twitter.com/TwilaWingrove) Andrew Monroe @monroeandrew (https://twitter.com/MonroeAndrew) Chris Holden @profcjholden (https://twitter.com/profcjholden) You can contact Marginally Significant on Twitter (@marginallysig (https://twitter.com/MarginallySig)), through email (marginallysig@gmail.com), or on the web (marginallysignificant.fireside.fm/contact (https://marginallysignificant.fireside.fm/contact)).

Evolutionary Psychology has been criticized as simply generating "just-so" stories—plausible explanations that lack evidence. In this episode, Smith and Monroe question whether evolutionary psychology is useful for generating predictions rather than simply generating post-hoc stories. Chris—the evolutionary psychology expert in the group—defends his area and articulates the instances where evo psych can help inform people's predictions. We also get a bit sidetracked talking about sperm competition theory. Marginally Significant is hosted by: Andrew Smith @andrewrsmith (https://twitter.com/AndrewRSmith) Twila Wingrove @twilawingrove (https://twitter.com/TwilaWingrove) Andrew Monroe @monroeandrew (https://twitter.com/MonroeAndrew) Chris Holden @profcjholden (https://twitter.com/profcjholden) You can contact Marginally Significant on Twitter (@marginallysig (https://twitter.com/MarginallySig)), through email (marginallysig@gmail.com), or on the web (marginallysignificant.fireside.fm/contact (https://marginallysignificant.fireside.fm/contact)).

People have attitudes they are aware of (explicit attitudes) but also supposidly have attitudes they don't know they have (implicit attitudes). Did you know you might love the Backstreet Boys, even though you think you hate them? This distinction between implicit and explicit attitudes has been extremely influential in Social Psychology and many other fields of social science. It has also led to the development of (mostly ineffective) implicit bias training. In this episode, Smith questions the distinction between implicit and explicit attitudes. Certainly, there are different ways of measuring attitudes, but it is unclear if these different measures tap into separate constructs or are simply different ways of measuring the same construct. Marginally Significant is hosted by: Andrew Smith @andrewrsmith (https://twitter.com/AndrewRSmith) Twila Wingrove @twilawingrove (https://twitter.com/TwilaWingrove) Andrew Monroe @monroeandrew (https://twitter.com/MonroeAndrew) Chris Holden @profcjholden (https://twitter.com/profcjholden) You can contact Marginally Significant on Twitter (@marginallysig (https://twitter.com/MarginallySig)), through email (marginallysig@gmail.com), or on the web (marginallysignificant.fireside.fm/contact (https://marginallysignificant.fireside.fm/contact)).

We all have active research labs that meet on a regular basis. Typically, we discuss our current projects, train students on running our studies, and perhaps have students present their findings. However, can lab meetings be used for more than just discussing our own research? Are there practical skills or useful information we could cover during lab meetings that would be helpful for our students? In this episode, we talk about what we currently do in our lab meetings. Perhaps more importantly, we discuss what we could be doing to most effectively use this time for the benefit of our graduate and undergraduate students. Marginally Significant is hosted by: Andrew Smith @andrewrsmith (https://twitter.com/AndrewRSmith) Twila Wingrove @twilawingrove (https://twitter.com/TwilaWingrove) Andrew Monroe @monroeandrew (https://twitter.com/MonroeAndrew) Chris Holden @profcjholden (https://twitter.com/profcjholden) You can contact Marginally Significant on Twitter (@marginallysig (https://twitter.com/MarginallySig)), through email (marginallysig@gmail.com), or on the web (marginallysignificant.fireside.fm/contact (https://marginallysignificant.fireside.fm/contact)).

Don’t email us with questions about this episode until you’ve read the syllabus! Students often ask questions that could easily be answered if they read the syllabus. In this episode we talk about whether it is a realistic expectation that our students read the syllabus before asking questions, what information we put in a syllabus, whether our policies sometimes deviate from what the syllabus states, and if the syllabus does—or at least should—act as a contract between the professor and the students. Marginally Significant is hosted by: Andrew Smith @andrewrsmith (https://twitter.com/AndrewRSmith) Twila Wingrove @twilawingrove (https://twitter.com/TwilaWingrove) Andrew Monroe @monroeandrew (https://twitter.com/MonroeAndrew) Chris Holden @profcjholden (https://twitter.com/profcjholden) You can contact Marginally Significant on Twitter (@marginallysig (https://twitter.com/MarginallySig)), through email (marginallysig@gmail.com), or on the web (marginallysignificant.fireside.fm/contact (https://marginallysignificant.fireside.fm/contact)).

How do we teach students about the replication crisis in a way that is honest but also doesn’t completely undermine their trust in psychological science? In this episode, we describe what we’ve done in the past and discuss possible strategies we can use in the future. Marginally Significant is hosted by: Andrew Smith @andrewrsmith (https://twitter.com/AndrewRSmith) Twila Wingrove @twilawingrove (https://twitter.com/TwilaWingrove) Andrew Monroe @monroeandrew (https://twitter.com/MonroeAndrew) Chris Holden @profcjholden (https://twitter.com/profcjholden) You can contact Marginally Significant on Twitter (@marginallysig (https://twitter.com/MarginallySig)), through email (marginallysig@gmail.com), or on the web (marginallysignificant.fireside.fm/contact (https://marginallysignificant.fireside.fm/contact)).

Welcome to our new, shorter episodes. In this episode, we discuss our experiences with teaching about political, religious, and other potentially sensitive topics in our classes. We talk about ways that we’ve handled these topics in the past, issues that have come up, and give suggestions about how to mitigate potential problems. Marginally Significant is hosted by: Andrew Smith @andrewrsmith (https://twitter.com/AndrewRSmith) Twila Wingrove @twilawingrove (https://twitter.com/TwilaWingrove) Andrew Monroe @monroeandrew (https://twitter.com/MonroeAndrew) Chris Holden @profcjholden (https://twitter.com/profcjholden) You can contact Marginally Significant on Twitter (@marginallysig (https://twitter.com/MarginallySig)), through email (marginallysig@gmail.com), or on the web (marginallysignificant.fireside.fm/contact (https://marginallysignificant.fireside.fm/contact)).

In part 1 of this episode, Monroe rants about why we should publish fewer papers. He contends that there is too much mediocre research being published. Therefore, we should all choose to publish only the most meaningful and impactful research. In part 2 of the episode, we talk about using MTurk for participant recruitment and some of the issues with the platform. Monroe then tries to convince us that we should stop using MTurk and instead rely on other methods for recruiting participants. Marginally Significant is hosted by: Andrew Smith @andrewrsmith (https://twitter.com/AndrewRSmith) Twila Wingrove @twilawingrove (https://twitter.com/TwilaWingrove) Andrew Monroe @monroeandrew (https://twitter.com/MonroeAndrew) Chris Holden @profcjholden (https://twitter.com/profcjholden) You can contact Marginally Significant on Twitter (@marginallysig (https://twitter.com/MarginallySig)), through email (marginallysig@gmail.com), or on the web (marginallysignificant.fireside.fm/contact (https://marginallysignificant.fireside.fm/contact)).