Reqnroll.ReqnrollException : System.NullReferenceException: Object reference not set to an instance of an object Error After Converting from SpecFlow

[JordanPittIT]

We are in the process of converting one of our Azure DevOps Selenium test pipelines from SpecFlow to Reqnroll. We've been able to solve the issues we've hit until now. We are getting the following error message:

Message: 

Reqnroll.ReqnrollException : System.NullReferenceException: Object reference not set to an instance of an object.
   at JitterbitWithSpecFlow.Drivers.BrowserSeleniumDriverFactory.GetForBrowser(String browserId) in C:\Users\BRYANH\source\repos\Jitterbit\JitterbitWithSpecFlow\Drivers\BrowserSeleniumDriverFactory.cs:line 27
   at JitterbitWithSpecFlow.Drivers.WebDriver.GetWebDriver() in C:\Users\BRYANH\source\repos\Jitterbit\JitterbitWithSpecFlow\Drivers\WebDriver.cs:line 36
   at System.Lazy`1.ViaFactory(LazyThreadSafetyMode mode)
   at System.Lazy`1.ExecutionAndPublication(LazyHelper executionAndPublication, Boolean useDefaultConstructor)
   at System.Lazy`1.CreateValue()
   at System.Lazy`1.get_Value()
   at JitterbitWithSpecFlow.Drivers.WebDriver.get_Current() in C:\Users\BRYANH\source\repos\Jitterbit\JitterbitWithSpecFlow\Drivers\WebDriver.cs:line 24
   at JitterbitWithSpecFlow.BaseClasses.PageBase.GoToSite(String url) in C:\Users\BRYANH\source\repos\Jitterbit\JitterbitWithSpecFlow\BaseClasses\PageBase.cs:line 60
   at JitterbitWithSpecFlow.Pages.JitterbitSandboxPage.GoToJitterbitSandbox() in C:\Users\BRYANH\source\repos\Jitterbit\JitterbitWithSpecFlow\Pages\JitterbitSandboxPage.cs:line 39
   at JitterbitWithSpecFlow.Steps.Jitterbit.MgtConsole_AgentVerificationSteps.GivenUserWantsToVerifyAgents() in C:\Users\BRYANH\source\repos\Jitterbit\JitterbitWithSpecFlow\Steps\Jitterbit\MgtConsole_AgentVerificationSteps.cs:line 27

Stack Trace: 

MgtConsole_AgentVerificationSteps.GivenUserWantsToVerifyAgents() line 32
lambda_method40(Closure , IContextManager )
--- End of stack trace from previous location ---
BindingInvoker.InvokeBindingAsync(IBinding binding, IContextManager contextManager, Object[] arguments, ITestTracer testTracer, DurationHolder durationHolder)
TestExecutionEngine.ExecuteStepMatchAsync(BindingMatch match, Object[] arguments, DurationHolder durationHolder)
TestExecutionEngine.ExecuteStepAsync(IContextManager contextManager, StepInstance stepInstance)
TestExecutionEngine.OnAfterLastStepAsync()
TestRunner.CollectScenarioErrorsAsync()
MgtConsole_AgentStatusFeature.ScenarioCleanupAsync()
MgtConsole_AgentStatusFeature.VerifyAgentStatus() line 17
GenericAdapter`1.GetResult()
AsyncToSyncAdapter.Await[TResult](TestExecutionContext context, Func`1 invoke)
AsyncToSyncAdapter.Await(TestExecutionContext context, Func`1 invoke)
TestMethodCommand.RunTestMethod(TestExecutionContext context)
TestMethodCommand.Execute(TestExecutionContext context)
<>c__DisplayClass1_0.<Execute>b__0()
DelegatingTestCommand.RunTestMethodInThreadAbortSafeZone(TestExecutionContext context, Action action)

Standard Output: 

Feature: AventStack.ExtentReports.ExtentTest
Given User wants to verify Agents
Go to following url https://apps.na-east.jitterbit.com/identity/login[value]
-> error: System.NullReferenceException: Object reference not set to an instance of an object.
   at JitterbitWithSpecFlow.Drivers.BrowserSeleniumDriverFactory.GetForBrowser(String browserId) in C:\Users\BRYANH\source\repos\Jitterbit\JitterbitWithSpecFlow\Drivers\BrowserSeleniumDriverFactory.cs:line 27
   at JitterbitWithSpecFlow.Drivers.WebDriver.GetWebDriver() in C:\Users\BRYANH\source\repos\Jitterbit\JitterbitWithSpecFlow\Drivers\WebDriver.cs:line 36
   at System.Lazy`1.ViaFactory(LazyThreadSafetyMode mode)
   at System.Lazy`1.ExecutionAndPublication(LazyHelper executionAndPublication, Boolean useDefaultConstructor)
   at System.Lazy`1.CreateValue()
   at System.Lazy`1.get_Value()
   at JitterbitWithSpecFlow.Drivers.WebDriver.get_Current() in C:\Users\BRYANH\source\repos\Jitterbit\JitterbitWithSpecFlow\Drivers\WebDriver.cs:line 24
   at JitterbitWithSpecFlow.BaseClasses.PageBase.GoToSite(String url) in C:\Users\BRYANH\source\repos\Jitterbit\JitterbitWithSpecFlow\BaseClasses\PageBase.cs:line 60
   at JitterbitWithSpecFlow.Pages.JitterbitSandboxPage.GoToJitterbitSandbox() in C:\Users\BRYANH\source\repos\Jitterbit\JitterbitWithSpecFlow\Pages\JitterbitSandboxPage.cs:line 39
   at JitterbitWithSpecFlow.Steps.Jitterbit.MgtConsole_AgentVerificationSteps.GivenUserWantsToVerifyAgents() in C:\Users\BRYANH\source\repos\Jitterbit\JitterbitWithSpecFlow\Steps\Jitterbit\MgtConsole_AgentVerificationSteps.cs:line 27 (0.2s)

We traced the error to this bit of code, but am unsure of how to resolve it:

<?xml version="1.0" encoding="utf-8"?>
<TestProfile xmlns="http://www.specflow.org/schemas/plus/TestProfile/1.5">
      <Settings projectName="JitterbitWithSpecFlow" name="UPitt Jitterbit" />
      <Execution stopAfterFailures="0" retryFor="None" testThreadCount="1" testSchedulingMode="Sequential" />
      <TestAssemblyPaths>
            <TestAssemblyPath>JitterbitWithSpecFlow.dll</TestAssemblyPath>
      </TestAssemblyPaths>
      <Report>
            <Template name="Report\A2WReportTemplate.cshtml" outputName="Jitterbit_TestLog_{now}.html" />
      </Report>
      <Targets>
            <Target name="Chrome">
                  <Filter>Browser_Chrome</Filter>
                  <DeploymentTransformationSteps>
                        <EnvironmentVariable variable="Test_Browser" value="Chrome" />
                  </DeploymentTransformationSteps>
            </Target>
      </Targets>
</TestProfile>

Any assistance that can be provided would be greatly appreciated. Let me know if you need any further information.

[clrudolphi]

Can you share your binding code, especially any Hooks? Otherwise, we can only speculate.

A typical problem that users experience when converting from SpecFlow is that Reqnroll handles threads slightly differently and supports multithreaded test execution. In some test frameworks this is turned on by default and can create problems if your test code was not expecting multiple tests to execute simultaneously.
For instance, any use of Thread LocalStorage is likely going to break when used with Reqnroll.

[JordanPittIT]

The string variable browserId. That, in turn, was supposed to be retrieved by the  Environment.GetEnvironmentVariable("Test_Browser") call in WebDriver.cs file (line 35). We have determined it is supposed to be retrieving that information from the Jitterbit.srprofile file, but it is not and we are not sure how to resolve it.

See below for the WebDriver.cs file, if you need it:

using OpenQA.Selenium;
using OpenQA.Selenium.Support.UI;
using System;

namespace JitterbitWithSpecFlow.Drivers
{
public class WebDriver : IDisposable
{
private readonly BrowserSeleniumDriverFactory _browserSeleniumDriverFactory;
private readonly Lazy _currentWebDriverLazy;
private readonly Lazy _waitLazy;
private readonly TimeSpan _waitDuration = TimeSpan.FromSeconds(10);
private bool _isDisposed;
internal object CurrentWindowHandle;

    public WebDriver(BrowserSeleniumDriverFactory browserSeleniumDriverFactory)
    {
        _browserSeleniumDriverFactory = browserSeleniumDriverFactory;
        _currentWebDriverLazy = new Lazy<IWebDriver>(GetWebDriver);
        _waitLazy = new Lazy<WebDriverWait>(GetWebDriverWait);
    }

    public IWebDriver Current => _currentWebDriverLazy.Value;

    public WebDriverWait Wait => _waitLazy.Value;

    private WebDriverWait GetWebDriverWait()
    {
        return new WebDriverWait(Current, _waitDuration);
    }

    private IWebDriver GetWebDriver()
    {
        var testBrowserId = Environment.GetEnvironmentVariable("Test_Browser");
        return _browserSeleniumDriverFactory.GetForBrowser(testBrowserId);
    }

    public void Dispose()
    {
        if (_isDisposed)
        {
            return;
        }

        if (_currentWebDriverLazy.IsValueCreated)
        {
            Current.Quit();
        }

        _isDisposed = true;
    }
}

}

[clrudolphi]

Your first post above included a bit of XML that appears to have been left over from SpecFlow, the . Reqroll does not use these files for configuration. Perhaps that is the source of confusion? (I'm guessing here as I'm not familiar with their use, but if you were depending upon the content of the to set an environment variable that would later be read by the GetWebDriver() method, then that may be the source of the issue)

Other than that, I'm not seeing anything that is wrong with Reqnroll related things.

[JordanPittIT]

Thanks, we'll give that a shot.

[JordanPittIT]

We tried removing the XML, but received the same error. One thing that occurred to me is that this is an srprofile file. My understanding is that Reqnroll doesn't use SpecFlow Runner (which admittedly, could be incorrect), so maybe we are looking in the wrong place for the root cause of the error.

[clrudolphi]

Reqnroll does not use the SpecFlow runner. I haven't confirmed it myself, but my presumption is that attempting to run Reqnroll tests with the SpecFlow runner will fail.
Reqnroll tests are intended to be executed by the underlying Test framework (NUnit, xUnit, MsTest) or simply dotnet test.