Taucraft Development: 2011

пятница, 7 октября 2011 г.

Freedom of Functional Tests

Looking at our functional tests (FTs) we can highlight several problems:

Synchronization code here like WaitFor is everywhere.

[When("opened Find Duplicate popup")]
public void OpenFindDuplicatePopup()
{
	Context.SeleniumInstance.Click("//a[.='Find Duplicate']");
	Synchronizer.WaitForAjax();
}

[When("wait for page to load")]
public void WaitForPageToLoad()
{
	Context.SeleniumInstance.WaitForPageToLoad(Config.WaitForPageToLoad);
	Synchronizer.WaitForAjax();
}

[When("clicked on Mark as Duplicate button")]
public void ClickMarkAsDuplicate()
{
	Context.SeleniumInstance.Click("//button[.='Mark as Duplicate']");
	Synchronizer.WaitForAjax();
}

xpaths everywhere, and not many of them shared.
We also depend on page structure while looking for web element heavily
Dependency on TP database.
As our FTs depends on direct connection to database it prevents us to run them against any instance of TP and share tests with plugin developers from other companies.
Contexts (AKA testing environment like 'create a project for a process, put user stories and assign a user then proceed') are not defined and not shared across all FTs

For now agreed on following decisions:

Synchronization code here like WaitFor is everywhere

xpaths everywhere, and not many of them shared.

The solution is simple: heavily use PageObject pattern.

The rule regarding xpath:

Don't use xpath.

We should rather use css selectors as they are much more stable to page structure changes. Css selectors used for testing should start with _ prefix

public IWebElement FirstNameInput
{
	get { return _browser.FindElement(By.CssSelector("input._firstName")); }
}

Page Objects design rules:


Page Object should be always created via DI container (structure map in our case). This will make our code more flexible in the matter of changes




The you can revise the following articles regarding best practices DI usage:



http://code.google.com/docreader/#p=google-guice&s=google-guice&t=MinimizeMutability








Poor-Man DI Antipattern Description



http://initializecomponent.blogspot.com/2008/06/container-dependency-anti-pattern.html





Dependency on TP database



Use REST to perform quick manipulation of Target Process site.








Contexts 



Different tests may use the same contexts in the matter of system under test (SUT) test.



Some of tests may use slightly different contexts.








It is necessary to provide a possibility to reuse contexts or their parts across the FTs.












Context Architecture















Whole Picture for new-style FTs

Location:vulica Šaranhoviča,Minsk,Belarus

среда, 14 сентября 2011 г.

Subversion Plugin Mashups now are running by CI server

For a long time we have many mashups javascript unit tests implemented.

Until now they were runnable by hand only, but it's not an option.

There is a MashupSpecs C# unit test introduced today into Tp.Subversion.Tests.

It's written in C# with using of WebDriver. It opens a web page with javascript unit tests, then gathers results. If any errors acquired then it will fail the build.

Now it's quite simple implementation and may be improved:

[TestFixture]
	public class MashupSpecs
	{
		private IWebDriver _webDriver;
 
		[SetUp]
		public void Init()
		{
			_webDriver = new RemoteWebDriver(DesiredCapabilities.Firefox());
			_webDriver.Navigate().GoToUrl(string.Format(@"file:///{0}/UI/Tests/index.html", AppDomain.CurrentDomain.BaseDirectory));
		}
 
		[TearDown]
		public void Destroy()
		{
			_webDriver.Close();
			_webDriver.Dispose();
		}
 
		[Test]
		public void ShouldRunAllTests()
		{
			new WebDriverWait(_webDriver, TimeSpan.FromSeconds(10)).Until(x => x.FindElement(By.Id("qunit-banner")).GetAttribute("class") != string.Empty);
			var failedTests = _webDriver.FindElements(By.CssSelector("#qunit-tests>.fail"));
			failedTests.Should(Be.Empty, new FailedTestCollection(failedTests).ToString());
		}
	}
 
	public class FailedTestCollection : ReadOnlyCollection<IWebElement>
	{
		public FailedTestCollection(IList<IWebElement> list)
			: base(list) {}
 
		public override string ToString()
		{
			var result = new StringBuilder();
			foreach (var webElement in Items)
			{
				result.AppendLine(webElement.Text);
				result.AppendLine();
			}
			return result.ToString();
		}
	}

среда, 31 августа 2011 г.

Unicode support in NSIS

To support Unicode TP installer has been updated to Unicode NSIS v.2.46-1. Here is how to start using new version:

1. Install it. New installer can be found in the same trunk/Utilities/NSIS folder as the old one. After installation copy the contents of trunk/Utilities/NSIS/NSIS folder (i.e. Include and Plugins folders) to the directory where NSIS has been installed (most probably c:\Program Files(x86)\NSIS). Do not forget to update Path variable for NSIS if necessary.

2. Convert NSI-scripts to Unicode. Usually, all that needs to be done to convert old installation scripts to Unicode NSIS is convert the NSI script file from an ANSI text file to a UTF-16LE file or as of 2.42.3, UTF-8 file.

3. Update NSIS plugins. Newer versions of some plugins (such as AccessControl, OLEDB, some others) provide Unicode support so you won't have to make any changes in the way these plugins are used.

4. Update NSIS scripts if necessary. If some plugins don't have Unicode version then CallANSIPlugin.nsh (can be found in trunk/Utilities/NSIS/NSIS/Include) will help you: use PushAsANSI, PushAsUTF8, PopAsANSI, PopAsUTF8 to convert string arguments before passing them to and after retrieving result from a macros/function. If you are using System plugin make sure that you are not calling the ANSI specific Win32 API. Most such API end with the letter A, for example: MessageBoxA(). Such API should either be converted to the tchar version such as MessageBox() or the wide-char version such as MessageBoxW().

And that's it.

среда, 10 августа 2011 г.

DateTime and JavaScritSerializer

Hi, all!

Let me show you a small unit test

1 [Test]
2 public void ShouldSerializeDateCorrectly()
3 {
4 var date = new DateTime(2011, 8, 8);
5 var serialized = new JavaScriptSerializer().Serialize(date);
6 var deserialized = new JavaScriptSerializer().Deserialize<DateTime>(serialized);
7 Assert.That(deserialized, Is.EqualTo(date));
8 }

How do you think it will behave? I'll surprise you: it fails.

The reason of such a strange behavior is described here. The main point is that deserialization assumes the value is serialized using GMT time.

Ok, that's funny, but how exactly it can affect TargetProcess? We're moving to REST little by little, but there are still many places where client javascript code communicates with TP server through web services using the power of ScriptServiceAttribute. Guess how the data passed to server is deserialized?

So, please be careful when accessing DateTime objects passed from client javascript and don't forget to convert it to local time as I would do to make my test pass.

среда, 27 июля 2011 г.

The BDD scenario problems and solutions (for developers) meeting result

Recently we've acquired 4 opened issues connected with BDD-style development

Here they are:

The solutions were developed.

Too detailed requirements

We can solve it with macro commands.

Macro commands are just several action steps combined in one name.

In example, instead of writing

Given process 'All Practices' defined

And project 'TargetProcess' for process 'All Practices' created

We will be able to write:

Given TargetProcess project created

So, we need to be able to define an action step (macro command) which consists actually defined with using of two other action steps.

No test output will be hurt! The output will be just macro command, not it's internal action steps.

Too Many Action Steps

Actually, having many action steps is not a problem. The real problem is that we can't navigate through them during scenario writing.

It was decided to try to implement intellisence for bdd specs.

Badly Structured Specs Location

Indeed, it's quite hard to switch from unit tests organization (class-level) to bdd specs (feature-level).

We need to switch our structure to provided above.

среда, 20 июля 2011 г.

BDD Specs Meeting Followup

Today we discussed several issues connected with BDD specs and their role in QA and Dev Team collaboration.

As the resule the following agreements were achieved:

No User Story should be implemented or taken in In Progress state without specs (QA + Dev Team + Product Owner)
User Story specs should be updated with possible BDD scenarious. Those specs should be introduced as Test Cases (QA)
Specs should be revised by Dev Team and updated if necessary (QA+Dev Team)
Specs (formed Test Cases) should be marked as Passsed when implemented (Dev Team)

понедельник, 18 июля 2011 г.

Feature toggling in TP

Recently some feature toggling utilities were introduced in TargetProcess.

All the features are enumerated at TpFeature enum:

public enum TpFeature
{
None = 0,
NewPopEmailIntegration,
TestCaseLibrary,
Solution,
...
}

Features are toggled on/off in web.config

<TpFeatures>
 <add Feature="NewPopEmailIntegration" />
 <!--<add Feature="Solution" />-->
 <!--<add Feature="TestCaseLibrary" />-->
 <!--<add Feature="UserStoriesCountReport" />-->
 <!--<add Feature="BugCountReport" />-->
</TpFeatures>

Here are some use cases with samples.
1. I want to ignore some unit tests failed because I turned off the feature they're testing.

[Test]
[ToggleFeatureOff(TpFeature.Solution)]
public virtual void AttachToSolution()
{
...
}

It seems that attribute toggles tests on or off depending on feature configuration but unfortunately it’s not so clever. The attribute inherits nUnit IgnoreAttribute and is just descriptive to make the reason of ignorance more clear. This also will cause compile time errors when I'll be removing TpFeature member to fully remove or integrate feature. So, I won't forget about them.

2. I want to exclude some part of markup from page if feature is toggled off and include it when toggled on.

<tp:Toggle runat="server" Feature="Solution">
 <tp:EditLink ID="lnkAttach" runat="server" TypeOfEntity="Request" Text="Attach To Solution" ClientAction='<%#string.Format("ShowSolutionFinder({0},{1})", Eval("RequestID"), Eval("ProjectID"))%>' />
 <asp:Literal ID="separator3" runat="server">|</asp:Literal>
</tp:Toggle>

3.I want to include some part of markup to page when feature is toggled on and include another part of markup when feature is toggled off.

<tp:Toggle ID="newEmailIntegration" Feature="NewPopEmailIntegration" TurnedOn="true" runat="server">
 <p class="defaultLabel pb-5">
  Inbound Email Integration
 </p>
 <tp:InboundMailReplyEmail ID="tpInboundMailReplyEmailNew" runat="server" />
</tp:Toggle>
...
<tp:Toggle ID="oldEmailIntegration" Feature="NewPopEmailIntegration" TurnedOn="false" runat="server">
 ...
</tp:Toggle>

4. I want to hide some help steps (from Library.xml) when feature is toggled off.

<Step Key="BugsByState" Dependency="Project" Practice="BugTracking" Action="List" EntityType="Bug" Feature="BugCountReport">
 <ActionItem ActionID="seeBugsDistributionByState" />
</Step>
<Step Key="BugsBySeverity" Dependency="Project" Practice="BugTracking" Action="List" EntityType="Bug" />
<Step Key="BugsProgress" Dependency="Project" Practice="BugTracking" Action="List" EntityType="Bug" Feature="BugCountReport"/>

5. I want to exclude some sitemap nodes when feature is toggled off

<siteMapNode title="Test Case Library" url="~/..." action="List" entity="TestCase" key="TestCaseLibrary" feature="TestCaseLibrary">
 <siteMapNode title="Add/Edit Test Case" url="~/..." action="Edit" entity="TestCase" key="TestCaseLibrary" />
</siteMapNode>

6. I want to check if feature is enabled at any place in source code.

if (ObjectFactory.GetInstance<ITpFeatureList>().IsEnabled(TpFeature.Solution))
{
 yield return GetDescription(EmailTemplateName.RequestToSolutionAttached);
}

Visual Builds Board

<forceBuild

uri="http://jenkinsmaster-hv:8080/job/BuildBranch/build?delay=0sec"

body="name=BRANCH_TO_BUILD&value=$1&json=%7B%22parameter%22%3A+%7B%22name%22%3A+%22BRANCH_TO_BUILD%22%2C+%22value%22%3A+%22$1%22%7D%7D&Submit=Build" />

<branchTitle

namePattern="(?:US|Bug)#?(?<number>\d+).*"

titlePattern="\["(.*?)"\]"

title="$1"

sourceUri="http://plan.tpondemand.com/api/v1/Assignables/${number}?include=[Name]&format=array&token=zzzzzzzzzzzzzzz" externalUri="http://plan.tpondemand.com/View.aspx?ID=${number}"

</monitoredJobs>

</part>

</part>

</part>

</part>

</part>

</part>

</part>

</part>

</part>

</part>

</part>

</part>

</part>

</part>

</part>

</part>

</part>

</part>

</part>

</part>

</part>

</part>

</part>

</part>

</buildParts>

</jenkinsDashboardSection>

Xpath	Description	Sample
@uri	Root uri for Jenkins	http://jenkinsmaster-hv:8080
@interval	Pool interval	0:05:00
forceBuild/@uri	Link for "Force Build" button (actually, run the specific job with given parameters)	http://jenkinsmaster-hv:8080/job/BuildBranch/build?delay=0sec
forceBuild/@body	Body of POST request for "Force Build button". $1 is a placeholder for the build name
avatars	Section to get avatars for changes (now are hardcoded for @TargetProcess.com domain)
branchTitle	Settings to get branch descriptions from TP
branchTitle/@namePattern	Regex for Git branch name	(?:US\|Bug)#?(?<number>\d+).*
branchTitle/@sourceUri	Uri to TP Rest api to get an assignable name. Use placeholders defined in @namePattern	http://plan.tpondemand.com/api/v1/Assignables/${number}?include=[Name]&format=array&token=zzzz"
branchTitle/@titlePattern	How to get title from @sourceUri response	\["(.*?)"\]
branchTitle/@title	Title to display. Use placeholders from @titlePattern	$1
branchTitle/@externalUri	Uri for links on title. Use placeholders from @namePattern	http://plan.tpondemand.com/View.aspx?ID=${number}
monitoredJobs/job/@name	List of root jobs to monitor
buildParts/part	Definition of single bubble on a build
buildParts/part/@name	Name of bubble
buildParts/part/job/@name	Jobs to include to the bubble
buildParts/part/@mode	How bubble change the color of entire build (FailOnly - only red color is used, Unimportant - do not use the bubble color, Normal (default) - use red and yellow color).
buildParts/part/@aggregation	How bubble color is calculated. Optimistic - use "the best" status. Pessimistic (default) - use "the worst" status.

The dashboard is designed to show hierarchic jobs. For example, in our case we have the following hierarchy:

BuildAll

BuildUnitTests

UnitTestsPart1
...
UnitTestsPart7

BuildApplication

FastFuncTestPart1
...
FastFuncTestPart15

BuildPacakage

пятница, 7 октября 2011 г.

среда, 14 сентября 2011 г.

среда, 31 августа 2011 г.

среда, 10 августа 2011 г.

среда, 27 июля 2011 г.

среда, 20 июля 2011 г.

понедельник, 18 июля 2011 г.

пятница, 7 октября 2011 г.

среда, 14 сентября 2011 г.

среда, 31 августа 2011 г.

среда, 10 августа 2011 г.

среда, 27 июля 2011 г.

среда, 20 июля 2011 г.

понедельник, 18 июля 2011 г.