search source code project

Discussion in 'Java' started by cmk128@hotmail.com, Feb 15, 2007.

  1. Guest

    Hi
    Here is my project:

    1) Apache + tomcat + mysql (have to use JSP, no php)
    2) 3 servers : Linux FC6 , 2GB ram , 2.8Ghz
    3) Goal : to build a website to let people search the source code from
    over 1 million files.

    It is unable to use mysql to build the index from the source code
    because people can search "int x=0" rather than english word, so all
    the indexing server doesn't word. I guess every time the user submit a
    search, i use grep command to search all the 1 million files. But it
    is too slow, how can i improve it?

    thanks
    from Peter ()
     
    , Feb 15, 2007
    #1
    1. Advertising

  2. Guest

    Forgot to say, in my xeon 3Ghz server, i need 10 seconds to grep 20000
    files. If i need to grep 1 million files, then i need at least 500
    seconds, it is too slow.
    thanks
    from Peter
     
    , Feb 15, 2007
    #2
    1. Advertising

  3. dnass Guest

    On 15 fév, 10:41, wrote:
    > Forgot to say, in my xeon 3Ghz server, i need 10 seconds to grep 20000
    > files. If i need to grep 1 million files, then i need at least 500
    > seconds, it is too slow.
    > thanks
    > from Peter


    Hi,

    Have you tried Lucene http://lucene.apache.org/java/docs/

    you are welcome
    Dnas
     
    dnass, Feb 15, 2007
    #3
  4. Chris Uppal Guest

    wrote:

    > 3) Goal : to build a website to let people search the source code from
    > over 1 million files.


    Have you looked at OpenGrok ?

    (It uses Lucene as its text search engine internally, but adds stuff for
    specialising to searching and displaying code.)

    -- chris
     
    Chris Uppal, Feb 15, 2007
    #4
    1. Advertising

Want to reply to this thread or ask your own question?

It takes just 2 minutes to sign up (and it's free!). Just click the sign up button to choose a username and then you can ask your own questions on the forum.
Similar Threads
  1. ~~~ .NET Ed ~~~
    Replies:
    1
    Views:
    4,215
    Cowboy \(Gregory A. Beamer\)
    Feb 26, 2005
  2. ABC
    Replies:
    7
    Views:
    512
    abc my vclass
    Sep 29, 2005
  3. Replies:
    0
    Views:
    412
  4. Source Code Search Engine

    , Mar 13, 2005, in forum: C Programming
    Replies:
    0
    Views:
    336
  5. Abby Lee
    Replies:
    5
    Views:
    443
    Abby Lee
    Aug 2, 2004
Loading...

Share This Page