Talk:List of unit testing frameworks

Latest comment: 4 months ago by 172.221.253.181 in topic Additional Languages?

xUnit

edit

What is the difference between this article and the xUnit article? -- nolandda

Not all of these frameworks are xUnit. --Chris Pickett 05:59, 3 December 2006 (UTC)Reply

What qualifies something as following the xUnit framework? The RUnit package for R appears to follow the architecture laid out on the xUnit page, but here it says it doesn't. I'm no expert, so I'm wondering whether this is a mistake. 128.174.127.111 (talk) 17:11, 1 March 2013 (UTC)Reply

IMO, categorizing a framework as xUnit is subjective. What does it mean to be xUnit? Is it derived-from, based-on, consistent-with, similar-to...? I think such categorization falls into a wide grey line and as such is of limited value. I suggest removing the xunit classification info from the article altogether. Stevebroshar (talk) 13:22, 3 June 2024 (UTC)Reply

Layout: Tables

edit

I converted (then IP) the bullet-list page to a big number of small tables. The point was that then you have a TOC and can click on your language. Could we discuss the pros and cons of One-big-table versus Many-small-tables? --User77764 13:04, 3 December 2006 (UTC)Reply

Another reason for many small tables is that I want to introduce columns to the C++ table which don't make sense anywhere else. --User77764 13:11, 3 December 2006 (UTC)Reply

And to be able to do this, I will revert to the many tables version. This is no final decision of course. --User77764 13:31, 3 December 2006 (UTC)Reply

Yet another idea: There are many languages with only one framework listed. Maybe combine them all into a single table while those languages with multiple entries get tables of their own? --User77764 16:33, 3 December 2006 (UTC)Reply

That will make it annoying if and when new frameworks crop up, it should be all the same style I think. So many smaller tables is fine, if somewhat more cumbersome to maintain when adding a new category to each table. I was thinking one big table for the columns that can be common between languages, and smaller tables for the columns particular to a language, but then you have to maintain the list of frameworks in two places. So many smaller tables then, but add the xUnit column to all of them. I wish table-editing was wysiwyg, would make life easier. --Chris Pickett 17:54, 3 December 2006 (UTC)Reply
OK, so we go for one table per language... maybe add all columns that are explained at the top to all tables? --User77764 18:08, 3 December 2006 (UTC)Reply
Sure... and it seems better if the common columns in each table go before the language-specific ones, with the exception of Remarks. --Chris Pickett 18:42, 3 December 2006 (UTC)Reply
Ack. --User77764 20:31, 3 December 2006 (UTC)Reply

Expansion

edit

The list needs information. White boxes mean: We do not know. Anybody with sufficient knowledge please help out. Also, more columns should be added where appropriate. --User77764 14:58, 5 December 2006 (UTC)Reply

In the PHP category, Code Igniter is a "Web Application Framework" so even if it contains a Unit test suite, it seems to be in a wrong place. 193.49.124.107 15:25, 25 April 2007 (UTC)Reply

Add QtUnit? Based on CppUnit. -- pne (talk) 09:49, 5 November 2007 (UTC)Reply

Regarding language dialects

edit

The language list surely is too long. Recently an entry for Symbian was added. Now this is clearly NO language, is it? Afaik, they use C++ in some flavor. Anyways, they don't deserve an own entry. Where to place such candidates? --User77764 17:49, 15 December 2006 (UTC)Reply

I wasn't sure about that one either. You could merge it with C++, but is it really a C++ framework? What other ones did you want to merge? Chris Pickett 20:19, 15 December 2006 (UTC)Reply
Hmm, Transact-SQL and SQL? I don't know, most of the languages are unknown to me... (but I know more than one of them ;-) ) --User77764 18:28, 19 December 2006 (UTC)Reply
I think we should just leave it. If you can find an example where compilers for either one will happily accept the other, then sure, merge to the same language. Chris Pickett 11:18, 21 December 2006 (UTC)Reply
Well, I still think the list (of languages!) is too long. But then, the "article" lacks in more important areas, for sure. --User77764 00:28, 23 December 2006 (UTC)Reply

Specify Visual Basic 6 (VB6)

edit

I assume that the "Visual Basic" heading refers to Visual Basic Ver. 6, or at least I think it should. Visual Basic Ver. 6, a.k.a. "VB6", is of course quite distinct from VB .NET; the latter which I expect should be included under the ".NET programming languages" heading. So my suggestions: (1) change "Visual Basic" heading to "Visual Basic Ver. 6 (VB6)", and (2) remove csUnit entry from the VB6 group. csUnit already appears under the .NET programming languages, which it seems is correct -- from what I can tell, csUnit only supports .NET and does not support VB6. --Nmarler 16:42, 29 April 2007 (UTC)Reply

Emacs Lisp

edit

The link for the ELisp unit testing package times out - is this link broken? Autarch 20:27, 9 November 2007 (UTC)Reply

The link was indeed broken, as the server said the file didn't exist today. I added a link to the appropriate page as well as adding a link to another Elisp unit testing package. Autarch 16:24, 12 November 2007 (UTC)Reply

QTestLib

edit

Qt (toolkit) includes QTestLib. It should be on the list, but I'm not sure about the properties. --Ropez (talk) 12:50, 21 February 2008 (UTC)Reply

GLSL

edit

Why is UnitTestCg listed as supporting GLSL? It does not say so on the Google Code page, or anywhere at all. I believe that the author might have mixed it up with HLSL. --193.77.149.126 (talk) 07:08, 17 December 2008 (UTC)Reply

Fortran unit testing framework missing

edit

What about pFunit? [1]

ANTLR

edit

gUnit - ANTLR grammar testing [2] —Preceding unsigned comment added by Seaswiki (talkcontribs) 23:45, 24 December 2009 (UTC)Reply

Google mocking framework is not a testing framework

edit

What is it doing here? Also, Google Testing framework does not provide mocks - it uses google's Mocking framework to do that. Plus, it doesn't support exceptions in so far as that when one occurs when you don't specify it the entire testing framework falls over. —Preceding unsigned comment added by 82.210.249.81 (talk) 09:30, 7 May 2010 (UTC)Reply

UnitTest++ not xUnit like?

edit

According to the Wikipedia page, UnitTest++ has all the required features for being considered xUnit like, yet it's listed as a "no". —Preceding unsigned comment added by 82.210.249.81 (talk) 09:32, 7 May 2010 (UTC)Reply

edit

Many test frameworks have common names, so putting a wiki link to general page isn't helpful (eg. Fact, Specter and Pex). 99.237.58.158 (talk) 20:29, 22 May 2010 (UTC)Reply

Distinction between unit testing and mocking

edit

The distinction between a "unit testing framework" and a "mock framework" ought to be explained somewhere. Unit testing is often explained with nice examples in which unit testing suffice. This is fine as far as introducing unit testing goes. In my personal experience, unit testing does not make much sense without mocking support. —Preceding unsigned comment added by 142.169.202.4 (talk) 14:14, 22 July 2010 (UTC)Reply

That seems silly. Mocks are only useful when you are trying to "unit test" a component that by all rights should be covered by an integration test. Grauenwolf (talk) 06:41, 7 May 2012 (UTC)Reply

Time for a HEAVY trimming

edit

This list is already in WP:LINKFARM territory, and it isn't its only problem, as it also violates WP:LSC: if a complete list would include hundreds of entries, then you should use the notability standard to provide focus to the list.

Therefore, my suggestion here is to:

  1. First, remove every entry without an article (solves LSC)
  2. Then, remove the "Homepage" column as the external links would be provided by the wikilinked articles. (solves LINKFARM)

--M4gnum0n (talk) 16:31, 24 July 2012 (UTC)Reply

Linkfarm, yes. SpamLinks, no. In other, similar lists, links to product details pages or FAQ are supplied in their own column. That is what these should be converted to since they do not have refs. Also, other lists only have notable products, and by notable I mean, products with articles on Wikipedia. That is not a requirement on Wikipedia as M4gnum0n suggests, but it is a discussion point. I don't think this list would benefit from such pruning. --Walter Görlitz (talk) 16:35, 24 July 2012 (UTC)Reply
I don't really think the pruning is a discussion point, as the current state of the list contradicts my direct quotation of a guideline above. --M4gnum0n (talk) 17:18, 24 July 2012 (UTC)Reply
Thanks for sharing your opinion. I don't think that those guidelines apply here. --Walter Görlitz (talk) 18:08, 24 July 2012 (UTC)Reply
Then let's wait for a few days and see if something moves. --M4gnum0n (talk) 09:03, 25 July 2012 (UTC)Reply
OK, more than one week passed and no one chimed in. This led me to refer to the Dispute resolution policy, which I found somewhat confusing. If I read that correctly, it seems that the choice is between WP:3O, WP:DRN and WP:RFC. What do you think the right process should be? --M4gnum0n (talk) 11:05, 2 August 2012 (UTC)Reply
Third opinion is not binding and usually a waste of time particularly when someone who knows little chimes in. It's better just to go for an RFC. But I would like to reiterate, this isn't a link farm since there is additional information provided for most entries and so it is not a "'mere collection of external links or Internet directories". And as for selection criteria, not all are "supported by reliable sources". --Walter Görlitz (talk) 14:01, 9 August 2012 (UTC)Reply

RfC on trimming

edit

Should this list only contain items that already have an article? M4gnum0n (talk) 09:49, 17 August 2012 (UTC)Reply

  • No because there is information provided about the entries aside from the item's name which makes more than a mere collection, it adds value to the material to allow for comparison of the items. It also classifies them. While not all entries entry currently meet notability criteria for articles, entries have been verified, and it is reasonable to expect an article could be forthcoming in the future. This list is not too large to be useful to readers since it is grouped into smaller sections. --Walter Görlitz (talk) 14:06, 17 August 2012 (UTC)Reply
  • No, if the items are important to the scope of the article, it should not matter whether they are notable enough to have their own article. To offer an analogy, a scientific paper or study may not be important enough to warrant its own article, but could be mentioned in the article concerning its field of study. Silvrous (talk) 15:28, 2 September 2012 (UTC)Reply
  • No. Even if there were any merit to the criterion, it would not be relevant. WP rules are supposed to be aimed at constructiveness, not smugly rule-bound constipation. If it makes sense to refer to something in a reasonable context and good sense, as long as it is reasonably verifiable, in it goes. As for WG's comment, point(s) taken, but a more helpful lede should deal with such objections adequately, even if it does little beyond referring helpfully to the parent article. JonRichfield (talk) 03:08, 8 September 2012 (UTC)Reply
"WP rules are supposed to be aimed at constructiveness, not smugly rule-bound constipation. " {{citation-needed}} Andy Dingley (talk) 08:19, 8 September 2012 (UTC)Reply
My apologies; your challenge id obviously unanswerable. I shall invest in a cork immediately. JonRichfield (talk) 09:49, 8 September 2012 (UTC)Reply

xUnit.net

edit

I think that the remarks is not exact: from the license of NUNIT [license of NUNIT|http://nunit.org/index.php?p=license&r=2.6.2] i deduce that the creator is Philip A. Craig, in 2000. James W. Newkirk, the creator of xUnit.net, appears in the licence from 2002 to 2004. I think also that the [reference|http://stackoverflow.com/questions/261139/nunit-vs-mbunit-vs-mstest-vs-xunit-net] is not the most adecuate: i do not understand how it is posible deduce "xUnit.net is currently the highest rated .NET unit testing framework" from a Q/A, where, in this case, all the answers are personal opinions of the users. Maybe you can take as an indicator, but is a weak probe for an afirmation. — Preceding unsigned comment added by Narkha (talkcontribs) 11:55, 9 September 2013 (UTC)Reply

utPLSQL

edit

I am the current administrator of the utPLSQL project (I became involved in about September 2013). It is true that the project was dormant for a time, but over the last year or so, there have been a number of releases (http://utplsql.sourceforge.net/Doc/release.html) and the ticket trackers are maintained and responded to. I don't know if that's enough for it to be listed as "active" on this page? 90.208.0.226 (talk) 10:53, 21 March 2015 (UTC)Reply

edit

Hello fellow Wikipedians,

I have just added archive links to 9 external links on List of unit testing frameworks. Please take a moment to review my edit. If necessary, add {{cbignore}} after the link to keep me from modifying it. Alternatively, you can add {{nobots|deny=InternetArchiveBot}} to keep me off the page altogether. I made the following changes:

When you have finished reviewing my changes, please set the checked parameter below to true to let others know.

 Y An editor has reviewed this edit and fixed any errors that were found.

  • If you have discovered URLs which were erroneously considered dead by the bot, you can report them with this tool.
  • If you found an error with any archives or the URLs themselves, you can fix them with this tool.

Cheers.—cyberbot IITalk to my owner:Online 01:29, 12 January 2016 (UTC)Reply

edit

Hello fellow Wikipedians,

I have just added archive links to 2 external links on List of unit testing frameworks. Please take a moment to review my edit. If necessary, add {{cbignore}} after the link to keep me from modifying it. Alternatively, you can add {{nobots|deny=InternetArchiveBot}} to keep me off the page altogether. I made the following changes:

When you have finished reviewing my changes, please set the checked parameter below to true to let others know.

 Y An editor has reviewed this edit and fixed any errors that were found.

  • If you have discovered URLs which were erroneously considered dead by the bot, you can report them with this tool.
  • If you found an error with any archives or the URLs themselves, you can fix them with this tool.

Cheers.—cyberbot IITalk to my owner:Online 18:17, 13 February 2016 (UTC)Reply

edit

Hello fellow Wikipedians,

I have just added archive links to one external link on List of unit testing frameworks. Please take a moment to review my edit. If necessary, add {{cbignore}} after the link to keep me from modifying it. Alternatively, you can add {{nobots|deny=InternetArchiveBot}} to keep me off the page altogether. I made the following changes:

When you have finished reviewing my changes, please set the checked parameter below to true or failed to let others know (documentation at {{Sourcecheck}}).

 N An editor has determined that the edit contains an error somewhere. Please follow the instructions below and mark the |checked= to true

  • If you have discovered URLs which were erroneously considered dead by the bot, you can report them with this tool.
  • If you found an error with any archives or the URLs themselves, you can fix them with this tool.

Cheers.—cyberbot IITalk to my owner:Online 09:07, 29 February 2016 (UTC)Reply

edit

Hello fellow Wikipedians,

I have just added archive links to one external link on List of unit testing frameworks. Please take a moment to review my edit. If necessary, add {{cbignore}} after the link to keep me from modifying it. Alternatively, you can add {{nobots|deny=InternetArchiveBot}} to keep me off the page altogether. I made the following changes:

When you have finished reviewing my changes, please set the checked parameter below to true or failed to let others know (documentation at {{Sourcecheck}}).

 Y An editor has reviewed this edit and fixed any errors that were found.

  • If you have discovered URLs which were erroneously considered dead by the bot, you can report them with this tool.
  • If you found an error with any archives or the URLs themselves, you can fix them with this tool.

Cheers.—cyberbot IITalk to my owner:Online 04:11, 3 March 2016 (UTC)Reply

Clarify meaning of table columns

edit

Somebody please clarify the meaning of table columns. E.g. for the table for C++, what does the "Macros" column mean? Does it mean the framework has special logic to test macros? Does it mean test registration via macros? What about the "Generators" column? Does it mean the framework can generate (scaffold) test cases? A lot of these columns don't have obvious unambiguous meaning, even to those intimate to testing frameworks. How do we even know we are talking about the same thing across all frameworks? "Generator" may mean one thing to the developers/users of Boost Test, and a completely different thing to developers/users of Google Test. Without such clarifications, these tables are not really useful. — Preceding unsigned comment added by SwordAngel (talkcontribs) 15:06, 5 October 2016 (UTC)Reply

edit

Hello fellow Wikipedians,

I have just modified 8 external links on List of unit testing frameworks. Please take a moment to review my edit. If you have any questions, or need the bot to ignore the links, or the page altogether, please visit this simple FaQ for additional information. I made the following changes:

When you have finished reviewing my changes, you may follow the instructions on the template below to fix any issues with the URLs.

 Y An editor has reviewed this edit and fixed any errors that were found.

  • If you have discovered URLs which were erroneously considered dead by the bot, you can report them with this tool.
  • If you found an error with any archives or the URLs themselves, you can fix them with this tool.

Cheers.—InternetArchiveBot (Report bug) 23:02, 23 May 2017 (UTC)Reply

Internet section

edit

I think it should be renamed to "Web programming" or "Client-side scripting". Galzigler (talk) 15:33, 9 November 2017 (UTC)Reply

Yeah. Internet is a bad name for that section. It's a hard one to name since other sections are language-based or (like .net) based on some important aspect of the programming language. This section is not language based at all. Web programming seems too broad to me. Client-server is way too broad. Scripting is broad/off-the-mark. Something like: web server or web request seems good. Going to change it ... Stevebroshar (talk) 13:33, 3 June 2024 (UTC)Reply
edit

Hello fellow Wikipedians,

I have just modified 27 external links on List of unit testing frameworks. Please take a moment to review my edit. If you have any questions, or need the bot to ignore the links, or the page altogether, please visit this simple FaQ for additional information. I made the following changes:

When you have finished reviewing my changes, you may follow the instructions on the template below to fix any issues with the URLs.

 Y An editor has reviewed this edit and fixed any errors that were found.

  • If you have discovered URLs which were erroneously considered dead by the bot, you can report them with this tool.
  • If you found an error with any archives or the URLs themselves, you can fix them with this tool.

Cheers.—InternetArchiveBot (Report bug) 05:34, 3 January 2018 (UTC)Reply

More data

edit

I like C. I'm overwhelmed by the quantity of frameworks available. I will expand the section about C. I will add columns listing the following columns:

  1. Source implementation (whether it is in C, C++, TCL, Python or JavaScript, extensions to C)
  2. Compiler requirements (GCC, Clang, MSVC, compiler-specific extensions)
  3. Runtime requirements (standard library, a extended standard library, POSIX or more)
  4. Operating system requirements (Linux or BSD specific features)
  5. Year of creation
  6. Notable projects that use it
  7. moar

Shining Button (talk) 18:29, 20 March 2024 (UTC)Reply

I don't recommend adding that. Seems like noise WRT this article and wide tables are not readable and very hard to edit. If this is burning itch for you, which it seems to be, I recommend adding such info to each implementation's article. If it has no article, then create it or let it be since it's not notable. Stevebroshar (talk) 13:27, 3 June 2024 (UTC)Reply

Additional Languages?

edit

Should we be including more languages here? I can think of a few:

1. Rust

2. Kotlin

3. Godot

4. Dart 172.221.253.181 (talk) 01:58, 13 July 2024 (UTC)Reply