Regression script

Discussion in 'VHDL' started by jaspalbhullar@yahoo.com, Apr 4, 2008.

  1. Guest

    Hello,

    I need regression scripts for verification purposes, i.e. to run suit
    of testcases. Preferably to launch as many testcases simultaneously as
    per available licences at that time. That is, I don't want to run each
    testcase serially one after the other, this will take too long.

    It could be in Perl, tcl or c-shell (or for that matter in any other
    language which can be run on Linux)

    Thanks,
    Jaspal

    PS: If a suitable online resource is available, then please point it
    to me. Thanks.
    , Apr 4, 2008
    #1
    1. Advertising

  2. HT-Lab Guest

    <> wrote in message
    news:...
    > Hello,
    >
    > I need regression scripts for verification purposes, i.e. to run suit
    > of testcases. Preferably to launch as many testcases simultaneously as
    > per available licences at that time. That is, I don't want to run each
    > testcase serially one after the other, this will take too long.
    >
    > It could be in Perl, tcl or c-shell (or for that matter in any other
    > language which can be run on Linux)
    >
    > Thanks,
    > Jaspal
    >
    > PS: If a suitable online resource is available, then please point it
    > to me. Thanks.


    If you have access to Modelsim SE/Questa (and I assume other simulators have
    their own equivalent) check out their JobSpy/LSF/SunGrid environment.

    Hans
    www.ht-lab.com
    HT-Lab, Apr 4, 2008
    #2
    1. Advertising

  3. wrote:

    > I need regression scripts for verification purposes, i.e. to run suit
    > of testcases. Preferably to launch as many testcases simultaneously as
    > per available licences at that time. That is, I don't want to run each
    > testcase serially one after the other, this will take too long.
    > It could be in Perl, tcl or c-shell (or for that matter in any other
    > language which can be run on Linux)


    For simulation scripting I like sh style scripts using bash
    and/or python (which is very good at math)

    Why not csh?
    http://www.faqs.org/faqs/unix-faq/shell/csh-whynot/

    In sh, I declare functions in one script - - -
    ....
    run_tb()
    {
    cd $test_dir_v
    pwd
    make test_$entity_v
    echo running short sim
    source tb.sh
    return 0
    } ...

    - - - then source the functions and run
    the controlling script from another.
    I collect the return code after vsim
    exits, like this:
    somecommand
    fail="Error $?"
    if [ "$fail" != "Error 0" ]
    then
    ...

    You can run parallel vsim sessions
    by putting an '&' at the end of the
    vsim command, but this ties up a
    license per process and may or may
    not save any time. It also complicates
    the collection of return values.
    I might consider using multiple servers.

    Good luck.

    -- Mike Treseler
    Mike Treseler, Apr 4, 2008
    #3
  4. Guest

    Thanks for the replies, I am not familiar with bash or python however
    from the code it appears that the first function needs to be called
    for every test case that is to be run, with 'tb.sh' containing the
    vsim command and flags / options etc. So I must also have another
    script, which defines the working directory for each of the testcase
    and one more to check the results from each one.
    However what if a licence is not currently available, will the request
    for it will automatically get queued or rest of the testcases won't
    run at all?
    Yes I meant launching the jobs on different machines / servers.

    I did a brief search on mentor's website and found about JobSpy, it
    doesn't seem be a regression launcher, rather a tool to spy about you
    jobs in a batch mode. Though it sounds useful, as it can tell you
    about the status of your regression run.

    Jaspal
    , Apr 5, 2008
    #4
  5. wrote:
    > it appears that the first function needs to be called
    > for every test case that is to be run, with 'tb.sh' containing the
    > vsim command and flags / options etc. So I must also have another
    > script, which defines the working directory for each of the testcase
    > and one more to check the results from each one.


    I put all the functions and constants into one file.
    There are lots of them.
    After I say
    source my_functions.sh

    everything is visible to the shell,
    and I can run the executable main script.

    > However what if a license is not currently available, will the request
    > for it will automatically get queued or rest of the testcases won't
    > run at all?


    The license server queues requests, but
    your script would have to handle the return codes
    and timeouts somehow.

    -- Mike Treseler
    Mike Treseler, Apr 5, 2008
    #5
  6. HT-Lab Guest

    <> wrote in message
    news:...
    > Thanks for the replies, I am not familiar with bash or python however
    > from the code it appears that the first function needs to be called
    > for every test case that is to be run, with 'tb.sh' containing the
    > vsim command and flags / options etc. So I must also have another
    > script, which defines the working directory for each of the testcase
    > and one more to check the results from each one.
    > However what if a licence is not currently available, will the request
    > for it will automatically get queued or rest of the testcases won't
    > run at all?


    As Mike said, yes, for Modelsim this is the default behaviour (disable with
    the -lic_noqueue). If you want to talk to Flexlm in your script then simple
    invoke "lmstat -f" (on windows lmutil lmstat -f) and parse the resulting
    output.

    > Yes I meant launching the jobs on different machines / servers.
    >
    > I did a brief search on mentor's website and found about JobSpy, it
    > doesn't seem be a regression launcher, rather a tool to spy about you
    > jobs in a batch mode. Though it sounds useful, as it can tell you
    > about the status of your regression run.


    This appsnote might answer a few questions;

    http://www.model.com/products/pdf/appnotes/GridWare.pdf

    I would also look at Checkpoint&Restore, creating a seperate elaboration
    file and using the -filemap_elab argument,

    Hans
    www.ht-lab.com


    >
    > Jaspal
    HT-Lab, Apr 5, 2008
    #6
    1. Advertising

Want to reply to this thread or ask your own question?

It takes just 2 minutes to sign up (and it's free!). Just click the sign up button to choose a username and then you can ask your own questions on the forum.
Similar Threads
  1. jackson marshmallow

    exp regression?

    jackson marshmallow, Jul 17, 2003, in forum: Java
    Replies:
    4
    Views:
    2,939
    Jos A. Horsmeier
    Jul 19, 2003
  2. Craig Matthews

    Latent class regression in Java?

    Craig Matthews, Jul 23, 2003, in forum: Java
    Replies:
    2
    Views:
    520
    Shashank Tripathi
    Jul 26, 2003
  3. BODIN
    Replies:
    0
    Views:
    606
    BODIN
    Dec 8, 2003
  4. Darius Fatakia

    logistic regression implementations

    Darius Fatakia, Nov 16, 2003, in forum: C Programming
    Replies:
    2
    Views:
    340
    Martin Ambuhl
    Nov 16, 2003
  5. nikie

    Linear regression in NumPy

    nikie, Mar 17, 2006, in forum: Python
    Replies:
    15
    Views:
    13,638
    nikie
    Mar 24, 2006
Loading...

Share This Page