Flash Gordon said:
If the author claims not to have finished implementing the standard
then the claim matters,
I agree. If the Author does not claim compliance then it is not really
fair to test it and shout "not-compliant"
and I'm fairly sure it was within the last month I saw a post from
Jacob talking about what he had not finished implementing.
Also, I would not bother testing a compiler which does not claim compliance.
I disagree. Most compilers are not ISO C 99 compliant. In the embedded
sector most are not fully ISO C 90 compliant either.
Testing for compliance will show where they are and are not compliant.
However as long as they are not claiming compliance for areas where the
are not there is no problem. What testing does is confirm exactly how
the compiler performs.
There is no legal requirement for a fully compliant ISO C compiler.
Sounds about right for the last I heard.
What the testing does is confirm where it does and does not meet the ISO
C standard (and which version) It should also confirm any deviations
from the ISO C Standard. These deviations are usually in an appendix
of the compiler manual and testing should confirm this.
This is compiler *validation* but not certification. Thus the user
knows how the compiler will perform with the C syntax. However there is
a lot more to compiler testing that the language compliance test suites.
Most commercial compilers do have this testing and most non commercial
compilers don't for several reasons, the two industry standard language
test suites cost a lot of money (due to the immense amount of work
involved in them) and there are no other tests suites of comparable
standard available. It also requires other test and regression tests all
built to t the same standard (or higher) than the compiler.