- FRC Game Manual
- FRC Game Q&A

# Unit Testing

Unit testing is a method of testing code by dividing the code into the smallest “units” possible and testing each unit. In robot code, this can mean testing the code for each subsystem individually. There are many unit testing frameworks for most languages. Java robot projects have JUnit 5 available by default, and C++ robot projects have Google Test.

## Writing Testable Code

Note

This example can be easily adapted to the command-based paradigm by having `Intake` inherit from `SubsystemBase`.

Our subsystem will be an Infinite Recharge intake mechanism containing a piston and a motor: the piston deploys/retracts the intake, and the motor will pull the Power Cells inside. We don’t want the motor to run if the intake mechanism isn’t deployed because it won’t do anything.

To provide a “clean slate” for each test, we need to have a function to destroy the object and free all hardware allocations. In Java, this is done by implementing the `AutoCloseable` interface and its `.close()` method, destroying each member object by calling the member’s `.close()` method - an object without a `.close()` method probably doesn’t need to be closed. In C++, the default destructor will be called automatically when the object goes out of scope and will call destructors of member objects.

Note

Vendors might not support resource closing identically to the way shown here. See your vendor’s documentation for more information as to what they support and how.

Java

    import edu.wpi.first.wpilibj.DoubleSolenoid;
    import edu.wpi.first.wpilibj.PneumaticsModuleType;
    import edu.wpi.first.wpilibj.examples.unittest.Constants.IntakeConstants;
    import edu.wpi.first.wpilibj.motorcontrol.PWMSparkMax;

    public class Intake implements AutoCloseable {
      private final PWMSparkMax m_motor;
      private final DoubleSolenoid m_piston;

      public Intake() {
        m_motor = new PWMSparkMax(IntakeConstants.kMotorPort);
        m_piston =
            new DoubleSolenoid(
                PneumaticsModuleType.CTREPCM,
                IntakeConstants.kPistonFwdChannel,
                IntakeConstants.kPistonRevChannel);
      }

      public void deploy() {
        m_piston.set(DoubleSolenoid.Value.kForward);
      }

      public void retract() {
        m_piston.set(DoubleSolenoid.Value.kReverse);
        m_motor.set(0); // turn off the motor
      }

      public void activate(double speed) {
        if (isDeployed()) {
          m_motor.set(speed);
        } else { // if piston isn't open, do nothing
          m_motor.set(0);
        }
      }

      public boolean isDeployed() {
        return m_piston.get() == DoubleSolenoid.Value.kForward;
      }

      @Override
      public void close() {
        m_piston.close();
        m_motor.close();
      }
    }

C++ (Header)

    #include <frc/DoubleSolenoid.h>
    #include <frc/motorcontrol/PWMSparkMax.h>

    #include "Constants.h"

    class Intake {
     public:
      void Deploy();
      void Retract();
      void Activate(double speed);
      bool IsDeployed() const;

     private:
      frc::PWMSparkMax m_motor{IntakeConstants::kMotorPort};
      frc::DoubleSolenoid m_piston{frc::PneumaticsModuleType::CTREPCM,
                                   IntakeConstants::kPistonFwdChannel,
                                   IntakeConstants::kPistonRevChannel};
    };

C++ (Source)

    #include "subsystems/Intake.h"

    void Intake::Deploy() {
      m_piston.Set(frc::DoubleSolenoid::Value::kForward);
    }

    void Intake::Retract() {
      m_piston.Set(frc::DoubleSolenoid::Value::kReverse);
      m_motor.Set(0);  // turn off the motor
    }

    void Intake::Activate(double speed) {
      if (IsDeployed()) {
        m_motor.Set(speed);
      } else {  // if piston isn't open, do nothing
        m_motor.Set(0);
      }
    }

    bool Intake::IsDeployed() const {
      return m_piston.Get() == frc::DoubleSolenoid::Value::kForward;
    }

## Writing Tests

Important

Tests are placed inside the `test` source set: `/src/test/java/` and `/src/test/cpp/` for Java and C++ tests, respectively. Files outside that source root do not have access to the test framework - this will fail compilation due to unresolved references.

In Java, each test class contains at least one test method marked with `@org.junit.jupiter.api.Test`, each method representing a test case. Additional methods for opening resources (such as our `Intake` object) before each test and closing them after are respectively marked with `@org.junit.jupiter.api.BeforeEach` and `@org.junit.jupiter.api.AfterEach`. In C++, test fixture classes inheriting from `testing::Test` contain our subsystem and simulation hardware objects, and test methods are written using the `TEST_F(testfixture, testname)` macro. The `SetUp()` and `TearDown()` methods can be overridden in the test fixture class and will be run respectively before and after each test.

Each test method should contain at least one assertion (`assert*()` in Java or `EXPECT_*()` in C++). These assertions verify a condition at runtime and fail the test if the condition isn’t met. If there is more than one assertion in a test method, the first failed assertion will crash the test - execution won’t reach the later assertions.

Both JUnit and GoogleTest have multiple assertion types; the most common is equality: `assertEquals(expected, actual)`/`EXPECT_EQ(expected, actual)`. When comparing numbers, a third parameter - `delta`, the acceptable error, can be given. In JUnit (Java), these assertions are static methods and can be used without qualification by adding the static star import `import static org.junit.jupiter.api.Assertions.*`. In Google Test (C++), assertions are macros from the `<gtest/gtest.h>` header.

Note

Comparison of floating-point values isn’t accurate, so comparing them should be done with an acceptable error parameter (`DELTA`).

Java

    import static org.junit.jupiter.api.Assertions.assertEquals;

    import edu.wpi.first.hal.HAL;
    import edu.wpi.first.wpilibj.DoubleSolenoid;
    import edu.wpi.first.wpilibj.PneumaticsModuleType;
    import edu.wpi.first.wpilibj.examples.unittest.Constants.IntakeConstants;
    import edu.wpi.first.wpilibj.simulation.DoubleSolenoidSim;
    import edu.wpi.first.wpilibj.simulation.PWMSim;
    import org.junit.jupiter.api.AfterEach;
    import org.junit.jupiter.api.BeforeEach;
    import org.junit.jupiter.api.Test;

    class IntakeTest {
      static final double DELTA = 1e-2; // acceptable deviation range
      Intake m_intake;
      PWMSim m_simMotor;
      DoubleSolenoidSim m_simPiston;

      @BeforeEach // this method will run before each test
      void setup() {
        assert HAL.initialize(500, 0); // initialize the HAL, crash if failed
        m_intake = new Intake(); // create our intake
        m_simMotor =
            new PWMSim(IntakeConstants.kMotorPort); // create our simulation PWM motor controller
        m_simPiston =
            new DoubleSolenoidSim(
                PneumaticsModuleType.CTREPCM,
                IntakeConstants.kPistonFwdChannel,
                IntakeConstants.kPistonRevChannel); // create our simulation solenoid
      }

      @SuppressWarnings("PMD.SignatureDeclareThrowsException")
      @AfterEach // this method will run after each test
      void shutdown() throws Exception {
        m_intake.close(); // destroy our intake object
      }

      @Test // marks this method as a test
      void doesntWorkWhenClosed() {
        m_intake.retract(); // close the intake
        m_intake.activate(0.5); // try to activate the motor
        assertEquals(
            0.0, m_simMotor.getSpeed(), DELTA); // make sure that the value set to the motor is 0
      }

      @Test
      void worksWhenOpen() {
        m_intake.deploy();
        m_intake.activate(0.5);
        assertEquals(0.5, m_simMotor.getSpeed(), DELTA);
      }

      @Test
      void retractTest() {
        m_intake.retract();
        assertEquals(DoubleSolenoid.Value.kReverse, m_simPiston.get());
      }

      @Test
      void deployTest() {
        m_intake.deploy();
        assertEquals(DoubleSolenoid.Value.kForward, m_simPiston.get());
      }
    }

C++

    #include <frc/DoubleSolenoid.h>
    #include <frc/simulation/DoubleSolenoidSim.h>
    #include <frc/simulation/PWMSim.h>
    #include <gtest/gtest.h>

    #include "Constants.h"
    #include "subsystems/Intake.h"

    class IntakeTest : public testing::Test {
     protected:
      Intake intake;  // create our intake
      frc::sim::PWMSim simMotor{
          IntakeConstants::kMotorPort};  // create our simulation PWM
      frc::sim::DoubleSolenoidSim simPiston{
          frc::PneumaticsModuleType::CTREPCM, IntakeConstants::kPistonFwdChannel,
          IntakeConstants::kPistonRevChannel};  // create our simulation solenoid
    };

    TEST_F(IntakeTest, DoesntWorkWhenClosed) {
      intake.Retract();      // close the intake
      intake.Activate(0.5);  // try to activate the motor
      EXPECT_DOUBLE_EQ(
          0.0,
          simMotor.GetSpeed());  // make sure that the value set to the motor is 0
    }

    TEST_F(IntakeTest, WorksWhenOpen) {
      intake.Deploy();
      intake.Activate(0.5);
      EXPECT_DOUBLE_EQ(0.5, simMotor.GetSpeed());
    }

    TEST_F(IntakeTest, Retract) {
      intake.Retract();
      EXPECT_EQ(frc::DoubleSolenoid::Value::kReverse, simPiston.Get());
    }

    TEST_F(IntakeTest, Deploy) {
      intake.Deploy();
      EXPECT_EQ(frc::DoubleSolenoid::Value::kForward, simPiston.Get());
    }

For more advanced usage of JUnit and Google Test, see the framework docs.

## Running Tests

Note

Tests will always be run in simulation on your desktop. For prerequisites and more info, see the simulation introduction.

For Java tests to run, make sure that your `build.gradle` file contains the following block:

    78test {
    79    useJUnitPlatform()
    80    systemProperty 'junit.jupiter.extensions.autodetection.enabled', 'true'
    81}

Use Test Robot Code from the Command Palette to run the tests. Results will be reported in the terminal output, each test will have a `FAILED` or `PASSED`/`OK` label next to the test name in the output. JUnit (Java only) will generate a HTML document in `build/reports/tests/test/index.html` with a more detailed overview of the results; if there are any failed tests a link to render the document in your browser will be printed in the terminal output.

By default, Gradle runs the tests whenever robot code is built, including deploys. This will increase deploy time, and failing tests will cause the build and deploy to fail. To prevent this from happening, you can use Change Skip Tests On Deploy Setting from the Command Palette to configure whether to run tests when deploying.