How to conduct remote UX research in black box industries

The intersection of user experience, Stakeholder research and climate technologies is crucial for climate innovations to be positioned for adoption at scale. As climate tech continues to evolve, the need for effective UX research  is pivotal, ensuring these innovations are user-friendly, efficient, and impactful across all stakeholders - Customers, end users, influencers and partners. 

That said, for early stage innovations, it could not always be feasible to conduct on-site research. That’s where using remote methodologies can prove to be an agile way to de-risk  product strategy.

Climate tech often encompasses technologies that include hardware components that are aimed at mitigating or adapting to the impacts of climate change. This includes renewable energy solutions, carbon capture technologies, sustainable agriculture practices, and more. Conducting UX research remotely for climate tech projects presents unique challenges and opportunities, especially for UX researchers and remote workers. This guide explores best practices, strategies, and actionable steps for conducting effective remote UX research for hard climate tech projects. 

UX research in climate tech ensures that these innovations are accessible, efficient, and meet the needs of users. By understanding user behaviors, needs, and pain points, UX researchers can help create climate tech solutions that are not only technologically advanced but also user-friendly. Let’s get into how we can use this 

1. Defining Research Objectives

Defining research objectives is essential for effective UX research, particularly for climate tech projects that include hardware components. Clear objectives ensure that your research is focused, productive, and aligned with the unique challenges and opportunities of climate technology. Start by clearly defining the objectives of your UX research. Identify the key questions you need to answer and the goals you aim to achieve. For climate tech projects, this might include understanding user interaction with new technology, identifying usability issues, or assessing user satisfaction. Here are the detailed steps to define research objectives in this context:

1. Understand the Context

Understanding the broader context of your project is crucial, especially in the climate tech space where both hardware and software components are involved. This involves:

• Stakeholder Interviews: Engage with stakeholders, including engineers, product managers, and sustainability experts, to understand the business goals, technical constraints, and environmental impact goals. Ask questions about what they hope to achieve and why.
• Market Research: Conduct secondary research to gather information about industry trends, regulatory requirements, competitors, and market demands specific to climate technology.
• Product Review: Gain a deep understanding of the product, including its hardware and software features, target audience, and unique selling points. Investigate how the hardware and software components interact and support climate goals.

2. Identify Key Questions

With a clear understanding of the context, start identifying the key questions that your research needs to answer. These questions should address both the hardware and software aspects of the climate tech solution. For example:

• What are the main usability challenges users face with our hardware components?
• How do users interact with the software interface that controls the hardware?
• What environmental and operational conditions impact the performance and usability of our product?
• How does the integration of hardware and software meet the needs of users focused on sustainability?

3. Prioritize Questions

Prioritize the questions based on their relevance to the project goals and the decisions they will inform. Consider:

• Impact: Which questions, when answered, will have the most significant impact on both the hardware and software aspects of the project?
• Feasibility: Which questions can be realistically answered within the constraints of time, budget, and resources?

4. Define Research Goals

Translate the prioritized questions into clear research goals. These goals should articulate what you aim to achieve through your research, addressing both hardware and software components. For example:

• To identify and prioritize user pain points with the hardware interface.
• To understand how users interact with and control the hardware through the software.
• To validate assumptions about user needs and behaviors in various environmental conditions.
• To assess the integration and interaction between hardware and software from a user’s perspective.

5. Determine Success Criteria

Establish criteria for success to measure the effectiveness of your research. This involves defining what success looks like for each research goal. For example:

• Success for identifying hardware user pain points might be a ranked list of the top five issues users face with the device.
• Success for understanding software interactions might be a detailed user journey map highlighting key interactions between the hardware and software.
• Success for validating environmental assumptions might be documented user feedback from real-world testing conditions.

6. Align with Stakeholders

Share your research objectives with stakeholders to ensure alignment. This step is crucial for securing buy-in and ensuring that everyone has a shared understanding of the research goals. Discuss:

• The relevance of the objectives to the project’s overall goals, including sustainability and user satisfaction.
• How the research findings will be used to inform decisions about both hardware and software components.
• Any adjustments needed based on stakeholder feedback.

7. Document the Objectives

Clearly document the research objectives and share them with the entire research team. This documentation serves as a reference throughout the research process, ensuring that the team remains focused and aligned. Include:

• A summary of the context and background.
• The key research questions.
• The prioritized research goals.
• The success criteria for each goal.

8. Revisit and Refine

Research objectives are not set in stone. As you progress through your research, new insights and challenges may emerge, especially in the dynamic field of climate tech. Revisit and refine your objectives as needed to ensure they remain relevant and aligned with the project’s evolving needs.

Behave like you are Erika Hall, the author of Just enough research. Now answer the next few questions. Detail out the steps of selecting the Right Tools and design research methods for the blog titled “ Remote UX Research for Climate Tech: A Comprehensive Guide”

2. Selecting the Right Tools

Before jumping into the design research methods, here are common tools that help support research, no matter what method you pick: 

1. Video Conferencing Software: Zoom or Microsoft Teams: For conducting remote interviews and meetings with stakeholders and participants. They offer reliable video and audio quality, recording capabilities, and screen sharing features.
2. Survey Platforms: Google Forms or SurveyMonkey: These platforms are great for creating and distributing surveys to gather quantitative data from users. They provide various question types and easy-to-analyze results.
3. Usability Testing Tools: UserTesting or Lookback to conduct remote usability testing sessions where you can observe participants interacting with your product in real-time. They provide video recordings, session notes, and usability metrics.
4. Project Management Tools: Trello or Asana to organize and manage your research project. They help in tracking tasks, deadlines, and collaboration among team members.
5. Qualitative Data Analysis Tools: NVivo or Atlas.ti: These tools assist in analyzing qualitative data from interviews and usability tests. They help in coding, categorizing, and finding patterns in your data.
6. Prototyping, Co-creation and Design Tools: Figma or Miro: These are essential for creating and iterating on design prototypes. They support collaboration and feedback collection, making it easier to refine your designs based on user insights.

In the context of conducting remote UX research for climate tech projects, which often include complex hardware and software components, it is crucial to select design appropriate research methods. Here’s how you can go about it: 

1. Remote Interviews:some text
   • Preparation: Develop a script with open-ended questions to encourage detailed responses. Ensure your setup is conducive to a smooth interview process.
   • Execution: Conduct the interviews using video conferencing tools. Record the sessions (with consent) for later analysis.
2. Surveys:some text
   • Design: Create surveys with clear, concise questions that target specific aspects of user experience. Use a mix of multiple-choice, Likert scale, and open-ended questions.
   • Distribution: Send out the surveys to a representative sample of your target users. Ensure anonymity and confidentiality to get honest responses.
3. Remote Usability Testing:some text
   • Planning: Define the tasks you want participants to perform using your product. Create scenarios that mimic real-world use cases.
   • Execution: Use usability testing tools to conduct the sessions. Observe participants as they complete tasks and take notes on their behavior and feedback.
   • Analysis: Review the recordings and notes to identify usability issues and areas for improvement.
4. Contextual Inquiry:some text
   • Setup: Schedule remote sessions where you can observe users in their natural environment, using the product in real-life scenarios.
   • Execution: Ask participants to share their screens and describe their actions and thoughts as they use the product or the model of the product. Take detailed notes and ask follow-up questions as needed.
5. Diary Studies:some text
   • Design: Ask participants to keep a diary of their interactions with the product over a set period. Provide guidelines on what to record, such as tasks performed, issues encountered, and overall satisfaction.
   • Collection: Regularly check in with participants to gather their diary entries and provide support.
   • Analysis: Review the entries to identify patterns and insights into long-term usage and user satisfaction.
6. Card Sorting:some text
   • Setup: Use online card sorting tools like OptimalSort to help participants organize information or features into categories that make sense to them.
   • Execution: Conduct the card sorting sessions remotely and analyze the results to inform information architecture and navigation design.

3. Recruiting Participants

Recruiting the right participants is crucial for the success of your UX research, especially when working on complex climate tech projects. Here are the steps to effectively recruit participants for remote UX research:

1. Define Your Target Audience

Begin by clearly identifying who your target users are. In climate tech projects, this may include:

• Environmental Scientists: Experts who can provide insights into the practical application of your technology.
• Engineers and Technicians: Users involved in the installation, maintenance, and troubleshooting of the hardware.
• Sustainability Advocates: Individuals passionate about sustainability who can provide feedback on the environmental impact and usability.
• Industry Partners: Individuals who have a clear understanding of the market application, needs and position where it would fit into their organizational structure.
• End-Consumers: General users who will interact with the final product.

2. Develop Participant Criteria

Establish specific criteria to ensure that participants are relevant to your research. Consider factors such as:

• Demographics: Age, gender, location, etc.
• Professional Background: Experience in relevant fields (e.g., renewable energy, environmental science).
• Technical Proficiency: Level of comfort with technology and specific hardware or software.
• Usage Patterns: Frequency and context of using similar products or technologies.

3. Create a Recruitment Plan

Outline a detailed plan that includes methods for finding and engaging potential participants. Your plan should cover:

• Recruitment Channels: Identify where and how you will find participants and people who can connect you to potential participants(e.g., professional networks, social media, industry events).
• Incentives: Determine what incentives you will offer to encourage participation (e.g., monetary compensation, gift cards, access to premium content, early/exclusive access to product).

4. Use Professional Networks and Industry Contacts

Leverage your existing professional networks and industry contacts to find qualified participants:

• LinkedIn: Post calls for participants in relevant groups or reach out directly to individuals in your network.
• Industry Associations: Collaborate with organizations related to climate tech and sustainability to reach their members.
• Academic Institutions: Contact universities or research institutions that focus on environmental science and technology.

5. Utilize Online Recruitment Platforms

Employ online platforms to reach a wider audience:

• User Research Platforms: Use services like UserTesting, Respondent, or User Interviews to find participants who meet your criteria.
• Social Media: Post recruitment ads on platforms like Twitter, Facebook, and LinkedIn to attract participants.

6. Screen Potential Participants

Ensure that participants meet your criteria by conducting a screening process:

• Screening Surveys: Create a brief survey to gather information about potential participants' backgrounds, experience, and relevance to your research.
• Follow-Up Interviews: Conduct short follow-up interviews to confirm eligibility and clarify any questions.

7. Manage Participant Logistics

Coordinate logistics to ensure a smooth experience for participants:

• Scheduling: Use scheduling tools like Calendly to arrange convenient times for interviews or testing sessions.
• Communication: Clearly communicate the research process, expectations, and how participants can prepare for the session.
• Technical Setup: Ensure participants have the necessary tools and technology to participate remotely (e.g., stable internet connection, required software).

8. Maintain Ethical Standards

Adhere to ethical guidelines throughout the recruitment process:

• Informed Consent: Provide clear information about the study and obtain informed consent from participants.
• Confidentiality: Assure participants that their data will be kept confidential and used solely for research purposes.
• Respect for Participants: Be considerate of participants' time and comfort, and ensure they can withdraw from the study at any time without penalty.

9. Build a Participant Database

Develop a database of potential participants for future studies:

• Database Management: Keep records of participants' contact information, screening data, and previous involvement.
• Engagement: Stay in touch with past participants and keep them informed about new research opportunities.

4. Conducting the remote research study

Remote interviews are an effective way to gather qualitative data. Prepare a script with open-ended questions to encourage detailed responses. Ensure your setup is conducive to a smooth interview process—check your internet connection, use a good microphone, and ensure a quiet environment.

Usability testing helps identify how users interact with your climate tech solution. Use remote usability testing tools to observe participants as they complete tasks. Record the sessions to review and analyze user behaviors and feedback later.

Effective communication and collaboration with your team are essential. Use project management tools like Trello or Asana to keep track of tasks and progress. Regular check-ins and updates ensure everyone is aligned and informed.

4.1 Preparing for the Study

Develop Study Materials

1. Scripts:
   • Create detailed scripts for interviews and usability testing, including clear, open-ended questions to guide conversations and ensure consistency.
   • Example: “Can you describe your experience using the new solar panel interface?”
2. Task Scenarios:
   • Design realistic scenarios that reflect real-world use cases of your climate tech product, encompassing both hardware and software interactions.
   • Example: “Please show how you would set up and monitor the solar panel system using the accompanying app.”
3. Consent Forms:
   • Prepare informed consent forms outlining the study’s purpose, procedures, and participant rights, ensuring compliance with ethical standards.
   • Ensure participants understand their data will be kept confidential and they can withdraw at any time.

Setup Logistics

1. Scheduling:some text
   • Use tools like Calendly to efficiently schedule sessions at times convenient for participants, accounting for different time zones if necessary.
   • Confirm appointments and send reminders to participants to ensure attendance.
2. Technical Setup:some text
   • Ensure participants have the necessary tools and technology for the study, such as a stable internet connection, webcam, and any specific software or hardware required.
   • Provide clear instructions on how to join the study sessions and troubleshoot common technical issues.

4.2 Conducting the Study

Ensuring ethical conduct is crucial for any research study. Make sure you follow the below fundamentals before beginning the study itself:

• Informed Consent:
  • Reiterate the purpose of the study and participants’ rights before starting each session.
  • Obtain explicit consent for recording and data usage.
• Confidentiality:
  • Assure participants their data will be kept confidential and used solely for research purposes.
  • Follow ethical guidelines to protect participant privacy throughout the study.

Steps to conduct the study:

• Remote Interviews
  • Build Rapport:
    • Start with a brief introduction, explaining the purpose of the study and setting a comfortable tone.
    • Use ice-breaker questions to make participants feel at ease.
  • Follow the Script:
    • Use your prepared script to guide the interview, but remain flexible to explore interesting insights that emerge.
    • Ask open-ended questions to encourage detailed responses.
  • Record Sessions:
    • With participants’ consent, record the sessions for detailed analysis later.
    • Ensure recordings are securely stored to maintain confidentiality.
• Remote Usability Testing
  • Explain the Process:
    • Clearly explain the tasks participants will perform and encourage them to think aloud as they interact with the product.
    • Example: “Please describe what you’re doing and thinking as you navigate through the solar panel setup app.”
  • Observe and Note:
    • Take detailed notes on user behavior, challenges, and feedback during the session.
    • Focus on identifying pain points, usability issues, and areas for improvement.
  • Minimal Interference:
    • Allow participants to interact with the product naturally, providing guidance only when absolutely necessary.
    • Avoid leading participants or influencing their actions to ensure authentic interactions.
• Contextual Inquiry
  • Natural Environment:
    • Observe participants using the product in their natural environment via screen sharing, noting how real-world conditions impact their interactions.
    • Pay attention to environmental factors that may affect usability, such as lighting conditions for solar panels.
  • Ask Questions:
    • Ask clarifying questions to understand participants’ actions and thought processes.
    • Example: “Why did you choose this setting on the solar panel interface?”

5. Synthesizing and Analyzing Data

Analyze the data collected from interviews and usability tests to identify patterns, pain points, and opportunities for improvement. Use qualitative data analysis tools like NVivo or Atlas.ti to organize and analyze your findings.Synthesizing data is a critical step in transforming raw research findings into actionable insights. This process involves organizing, analyzing, and interpreting the data collected during your study to identify key patterns and themes. Here’s how to effectively synthesize data for remote UX research in climate tech projects:

1. Organize and Prepare Data

Transcribe and Clean Data

• Transcription: Transcribe recorded interviews and usability testing sessions to create text versions of your audio and video data. This makes it easier to analyze and code.
• Cleaning: Review the transcriptions to correct any errors and ensure clarity. Remove any irrelevant information that does not pertain to your research objectives.

Collect and Centralize Data

• Centralize Data: Gather all your data in one place, including interview transcripts, survey responses, usability test notes, and contextual inquiry observations. Use a tool like Google Drive, Dropbox, or a dedicated research repository.
• Categorize Data: Organize the data into categories based on the type of information (e.g., usability issues, user feedback, environmental factors).

2. Code and Categorize Data

Initial Coding

• Coding Framework: Develop an initial coding framework based on your research questions and objectives. Codes are labels that represent specific themes or patterns in your data.
• Apply Codes: Systematically apply these codes to your data. Use qualitative data analysis tools like NVivo or Atlas.ti to streamline this process. For example, if participants frequently mention difficulty with a specific hardware component, label those segments with a relevant code like “hardware usability issue.”

Iterative Coding

• Refine Codes: As you work through the data, you may discover new themes that require additional codes. Refine your coding framework iteratively to ensure it captures all relevant information.
• Group Similar Codes: Group similar codes into broader categories to simplify analysis. For example, combine “hardware usability issue” and “software usability issue” under a broader category like “usability issues.”

3. Identify Patterns and Themes

Thematic Analysis

• Review Coded Data: Examine the coded data to identify recurring patterns and themes. Look for frequent mentions, common behaviors, and shared experiences among participants.
• Key Themes: Summarize the key themes that emerge from your analysis. For example, you might find that users consistently struggle with a particular feature in the software interface or face environmental challenges when using the hardware in certain conditions.

Create Visual Representations

• Affinity Diagrams: Use affinity diagrams to visually organize and group related insights. This helps in seeing the big picture and identifying connections between different themes.
• User Journey Maps: Develop user journey maps to illustrate how users interact with the product over time, highlighting pain points and areas for improvement.

4. Synthesize Insights

Summarize Findings

• Executive Summary: Create an executive summary that highlights the most important findings from your research. This should be a high-level overview that includes key themes, patterns, and significant insights.
• Detailed Report: Develop a detailed report that includes all the findings, categorized by themes. Include direct quotes from participants to support your points and provide context.

Prioritize Issues

• Impact and Feasibility: Prioritize the identified issues based on their impact on user experience and the feasibility of addressing them. Use a matrix to plot issues by their severity and ease of implementation.
• Actionable Recommendations: For each prioritized issue, provide specific, actionable recommendations for improvement. Ensure these recommendations are practical and aligned with project goals.

5. Iterate and Refine

Continuous ImprovementExplaination Image

• Feedback Loop: Establish a feedback loop with stakeholders to continuously refine your findings and recommendations based on their input and new data.
• Ongoing Research: Plan for ongoing research to address any new questions or challenges that arise. Use the insights from this study to inform future research efforts.

Explaination Image

‍

6. Presenting Findings

Presenting insights from your UX research effectively is crucial for ensuring that stakeholders understand and act on your findings. Here’s how to present the insights from a remote UX research study for climate tech projects:

1. Create Engaging Deliverables

Visual Aids

• Graphs and Charts: Use graphs and charts to present quantitative data clearly. For instance, a bar chart could show the frequency of specific usability issues.
• Infographics: Design infographics to visualize complex data and make it more digestible. Infographics can summarize key findings and highlight important statistics.
• User Journey Maps: Develop user journey maps to illustrate how users interact with the product over time, identifying key touch points, pain points, and moments of delight.

Detailed Reports

• Executive Summary: Start with an executive summary that highlights the most important findings and recommendations. This should be concise and focus on high-level insights.
• Thematic Findings: Organize the report by themes or categories that emerged during analysis. For example, separate sections for “Hardware Usability Issues” and “Software Interaction Challenges.”
• Quotes and Anecdotes: Include direct quotes from participants to provide context and bring the data to life. Anecdotes can help stakeholders understand the user’s perspective.

2. Tailor the Presentation to the Audience

Know Your Audience

• Stakeholder Analysis: Understand the interests and priorities of your stakeholders. Tailor your presentation to address their concerns and highlight the aspects of the research most relevant to them.
• Language and Jargon: Use language that your audience is familiar with. Avoid technical jargon if presenting to non-technical stakeholders, and focus on the implications of your findings.

Focus on Key Insights

• Prioritize Findings: Present the most critical insights first. These should be the findings that have the greatest impact on the user experience and the success of the product.
• Actionable Recommendations: Clearly link each insight to actionable recommendations. Explain how implementing these recommendations will address the identified issues.

3. Use Storytelling Techniques

Narrative Structure

• Introduction: Begin with a compelling introduction that outlines the purpose of the research and the key questions you aimed to answer.
• Middle: Present the main findings, supported by data and user quotes. Structure this section logically, following the user’s journey or the thematic categories.
• Conclusion: End with a strong conclusion that summarizes the key insights and emphasizes the importance of acting on the recommendations.

User Stories

• Persona-Based Stories: Use personas to tell stories about different types of users and their experiences with the product. This helps stakeholders empathize with the users and understand their needs.
• Scenarios: Create scenarios that illustrate common user interactions and challenges. These scenarios can highlight critical pain points and opportunities for improvement.

4. Facilitate Discussions and Feedback

Interactive Sessions

• Q&A Sessions: Allocate time for questions and answers at the end of your presentation. Encourage stakeholders to ask questions and engage in discussions.
• Workshops: Consider conducting workshops where stakeholders can brainstorm solutions based on the research findings. This collaborative approach can foster buy-in and generate innovative ideas.

Feedback Mechanisms

• Surveys: Distribute surveys to gather feedback on the presentation and the research findings. Use this feedback to refine your insights and recommendations.
• Follow-Up Meetings: Schedule follow-up meetings to discuss the implementation of recommendations and address any additional questions or concerns.

5. Document and Share Findings

Digital Reports

• PDF or Online Documents: Create digital versions of your detailed report and share them with stakeholders. Ensure the document is well-organized and easy to navigate.
• Slide Decks: Prepare a slide deck that summarizes the key findings and recommendations. Use this deck during your presentation and share it afterwards for reference.

Data Repositories

• Centralized Repository: Store all research data, reports, and presentations in a centralized repository accessible to all stakeholders. This ensures transparency and easy access to information.
• Regular Updates: Update the repository regularly with new findings, feedback, and implementation progress.

Conclusion

Remote UX research is a powerful tool for advancing climate tech innovations. By employing effective strategies and best practices, UX researchers and remote workers can ensure that these technologies are user-friendly, efficient, and impactful. As climate tech continues to evolve, the role of UX research will be pivotal in shaping a sustainable and user-centric future.

FAQs

1. Why is UX research important in climate tech? UX research ensures that climate tech solutions are user-friendly, efficient, and meet the needs of their users, enhancing their effectiveness and adoption.
2. What tools are useful for remote UX research? Tools like Zoom, Google Forms, UserTesting, Trello, and NVivo facilitate various aspects of remote UX research.
3. How do you recruit participants for climate tech UX research? Use social media, professional networks, recruitment services like UserBob, UserInterviews etc and industry contacts to find participants who are likely to interact with climate tech solutions.
4. What are some best practices for conducting remote UX research? Ensure participant comfort, embrace flexibility, focus on ethical considerations, and leverage diverse perspectives to enhance the quality of your research.

By following these guidelines, you can effectively conduct remote UX research for climate tech projects, driving innovations that are both user-friendly and impactful in the fight against climate change.