All Collections
Screening Test
Creating Custom Programming Question
Creating Custom Programming Question

Design your own question including starting code and test cases to score against.

Munir Usman avatar
Written by Munir Usman
Updated over a week ago

In addition to choosing from library, you can create your own programming question which can be specific to your industry. Or the expertise you are hiring for.

Remote Interview provides you with a powerful question creator which let's you create questions.

  • To do this, head over to Questions section.

  • Click Add Questions dropdown and select Create New Coding Question.

Adding Title and Description

The first part is for adding Title, Task Description, and Tags for your coding task.

As an example, I am creating a Hello World task in the following screenshot:

After this, click Next button to go to the next section.

Enabled Languages and Starting Code

You can limit the programming languages that are available to the candidate. 

This is useful if you are hiring for specific languages (like Bash, PowerShell here) and only want to test the skills in those languages.

You can also change the starting code for each enabled language. The candidate gets this boilerplate code when they start this question. 

After you are done with this section, click Next to add test cases.

Adding Test Cases

Remote Interview uses test cases to score the candidate's solution.

Here is an example test case for our hello world task:

A single test case consists of:

  • Standard Input: This is given to the submitted solution as STDIN, the solution should read this as instructed in the description.

  • Expected Output: Given the input, the candidate's code has to print output to STDOUT. This is matched against Expected Output.

  • Name: A name for this test case.

  • Points: If the produced output matches the expected output, the candidate is awarded the points you set for this test case.
    The total achieved points for the question is the sum of all points of correct test cases.

  • Is a Sample: When enabled, this test case is visible to the candidate when they are solving this problem. It's good to provide a few of your test cases as sample so the candidate can debug and fix their code.
    Cases which are not sample, are not visible to the candidate and can hold all the tricky edge cases you might want to add too.

After you have added your test cases, click Save. Here is how it looks like for our hello world problem:


Using the above format, you can create a large variety of questions. Get in touch if you need assistance in mapping your problem to the above format.

Did this answer your question?