Topic: CADtest - NUnit / Integration testing inside AutoCAD

[CADbloke]

Following on from...
http://www.theswamp.org/index.php?topic=39236.0
http://www.theswamp.org/index.php?topic=47549.5
http://www.theswamp.org/index.php?topic=47110
http://ossandcad.blogspot.com.au/2009/04/mbunit-autocad-unit-testing-for-cad.html
http://www.theswamp.org/index.php?topic=46703
and lots of other links I've since lost...

CADtest is on Github.
CADtest runs NUnitLite version 3 inside AutoCAD and/or the AutoCAD Core Console. See My discovery post for a screenshot

I translated it to VB as well.

Your comments and contributions are most welcome

[Kerry]

Thanks Ewen !

[MickD]

Yes, thanks indeed, nice job.
A lot of work there!

[CADbloke]

Cheers, I'm still going although I do have actual production work I should be doing whoops. I added a few dodgy SampleTests..cs|.vb. Curiously, running tests in accoreconsole.exe shows perfectly in version 2013 but has no console output in 2015...but running it in acad.exe v2015 is fine. In all cases it still writes TestResults.xml so it does actually work, you just can't see it in v2015's Core Console. Did they break it or is it just me? I even tried reinstalling AutoCAD.

The imaginatively named "Test_method_name()" is an example of why you may want to run a Unit...er, Integration test inside AutoCAD. once you start doing more complex things with objects the degree of difficulty in mocking or faking it anything is boringly high.

[CADbloke]

If you are following this, keep an eye on the commits in the GitHub repo because this is still a work in progress...

My latest brainwave - the Test Method should not commit anything to the database, these are supposed to be Unit Tests (I am defining "Unit" here as a "Unit of work", not so much in the isolationist sense as the simplest possible unit of code) so the database should be clean for each test. I changed the sample test and also the Resharper test method templates. Note the helper methods that test Test Methods call still commit their Transactions but as the Helpers are called from inside the Test Method they will all be rolled back when the Test Method's transaction is rolled back.

As an aside, running tests in the Core Console of AutoCAD 2015 is a broken experience (they still run but the console output is broken) but ... I didn't break it, apparently.

As always, your observations and suggestions are encouraged!

[Andrey Bushman]

I've not installed AutoCAD on the local machine, but I always use the remote debugging. Target remote machine has necessary installed AutoCAD versions (2009-2015) and Gallio. Usually, I write my Gallio-tests on the local machine (in the MSVS IDE) and save the result on the remote machine (the output path is the shared directory of the remote machine). Then I run this tests on the remote machine directly (through the Windows console), without any MSVS Remote Debugging Monitor and get the report in the HTML-format.

What software I must to install on the remote machine for testing through NUnit? I expect - I must install the NUnit - it is not a problem, but will be enough?

[CADbloke]

What software I must to install on the remote machine for testing through NUnit? I expect - I must install the NUnit - it is not a problem, but will be enough?

I haven't tried remote debugging yet - but I will!

You don't need to install NUnit on the remote machine -  the CADtest project at Github will get all the NUnit dependencies using Nuget and add them to the \bin\ folder. I have not installed NUnit 3 on my PC yet but CADtest runs ok. I have NUnit 2.6.4 installed and I know that version 2.x doesn't work in CADtest so I am sure it runs everything from the \bin\ folder.

NUnit's reporting format is XML but there are a few projects that convert it to HTML like https://github.com/SongArc/NUnit-HTML-Report-Generator/tree/develop and  https://github.com/relevantcodes/NUnitOrange or you can see the results in the console, even in acad.exe (but not theCore Console >v2013 because it looks like Autodesk broke it.

[Andrey Bushman]

CADbloke, you are the best! I was looking your sample and created second template: AutoCAD .NET Extension (NUnit Tests). It is based on the AutoCAD .NET Extension template. I will send it on your email too. Now I am playng with it still.

[Andrey Bushman]

Well... It is possible to write the tests and then compile this code for Gallio and NUnit without any changes - it works fine. It is like when we use the same code sources for building extensions of AutoCAD, nanoCAD and BricsCAD.

Tests, linked to Gallio framework works fine for any AutoCAD version (I checked for AutoCAD 2009 - 2015 x64 Enu).

Tests, linked to NUnit framework works fine for any AutoCAD version, newer than AutoCAD 2010. But at this case for AutoCAD 2011 - 2014 it is necessary to set the 0 as value for the NEXTFIBERWORLD variable and then restart AutoCAD. After finishing of testing, don't forget to set the 1 value for NEXTFIBERWORLD variable back.

It is impossible to use NUnit tests for AutoCAD older than 2011, because they has not NEXTFIBERWORLD variable. At this case it is possible only for Gallio.

[CADbloke]

I did not need to set NEXTFIBERWORLD to 0 (it is still 1 on my Dev machine). Did you set this attribute at the top of each test class?..

Code - C#: [Select]

1. [TestFixture, Apartment(ApartmentState.STA)]

(ok, yes, I see that in your email, I will leave this tip here for others)

I have not yet tried to run any CADtests in AutoCAD versions other than 2013 & 2015, both in acad.exe and acadcoreconsole.exe.

I keep all my CADtests in a separate project which references my main project as a <ProjectReference Include="...">, I also keep all my normal NUnit tests in another separate project because I run those tests in Visual Studio. I know it sounds messy but I think it is tidier because I like things to be in their own place. It also means I can unload those projects from the Visual Studio solution if I don't want to work on them today.

[Andrey Bushman]

Did you set this attribute at the top of each test class?..

Yes, I did.

I have not yet tried to run any CADtests in AutoCAD versions other than 2013 & 2015, both in acad.exe and acadcoreconsole.exe.

I tried to run with AnyCPU and acad.exe only. But I will try to do the same with x86|x64 and accoreconsole.exe surely.

I keep all my CADtests in a separate project which references my main project as a <ProjectReference Include="...">, I also keep all my normal NUnit tests in another separate project because I run those tests in Visual Studio. I know it sounds messy but I think it is tidier because I like things to be in their own place. It also means I can unload those projects from the Visual Studio solution if I don't want to work on them today.

You are right, I agree with you. My Idea was: the template has a "switcher" (property), which points a necessary result of building: either extension, or tests. I will do refactoring and create separate template instead of a single template which has all.

[Andrey Bushman]

Gallio can create report in the XML or HTML format. NUnit create XML report only. But HTML would be convenient for reading...

I tryed to use some converters:

1. This application displays content of XML file as readable string in the console. It works, but I want to get HTML.
2. This application must generate HTML for our XML, but it creates an empty HTML.
3. This application crashes own process.

Maybe NUnitLite creates XML with other structure... So, it is necessary to write a converter XML -> HTML for NUnit output result.

[Andrey Bushman]

Ewen,

Entry Point doesn't work in Unit Tests projects, therefore I will exclude Entry Point from the AutoCAD .NET Extension Unit Tests template. NUnit and Gallio see Entry Point has not tests and they refuse to work with it.

[CADbloke]

Hi Andrey, just a quick response to your questions about HML reports - #3 is a bug in their app - See https://github.com/nunit/nunit/issues/525

I saw http://relevantcodes.com/nunit-orange-nunit-html-report-generator/ which I though it was nice but I think it had a couple of bugs. I did have a look but I didn't get too far. More later. Good night.

[Andrey Bushman]

I saw http://relevantcodes.com/nunit-orange-nunit-html-report-generator/ which I though it was nice but I think it had a couple of bugs.

Thank you, it works.

Good night.