Sunday, January 31, 2010

Faceting and Multifaceting syntax in Solr 1.4

Introduction


So you've installed Solr 1.4 and you've managed to get some data indexed. Now you're ready to have some fun with faceting. Faceting is basically just filtering the results of a search without effecting the relevance score. Sites such as ebay use faceting to help narrow down the results of a generic search like TV, to give you options such as 32" wide-screen LCD etc.


 

It makes for a very pleasant user experience. It's one of the main reasons to use Solr and Solr makes this process very easy. There are actually 3 types of faceting. In this post I'm only going to talk about "field faceting". Once you've mastered "field faceting", the other 2 types ("query faceting" and "date faceting") are very easy and the basic Solr Wiki will be enough for you to get going.


Field Faceting


Now when you're indexing data in Solr, it's best to use the "text" field type, as this applies lots of filters which will help sort out plurals, remove white space etc. However when it comes to faceting, the values returned will be the values after the filters have been applied. Therefore it's best to create new versions of any fields you wish to facet.



You can use the copyfield keyword to make this process very easy.

For example if you have a field called county

Now, when you index county, Solr will use the text field for searching and the string field for displaying the facet results.

Lets get faceting

First up you'll need to turn on the faceting as it's turned off by default.

http://localhost:8080/solr/select/?q=*%3A*&rows=0&facet=on

To facet on a field, all you have to do is use the facet.field=fieldname

http://localhost:8080/solr/select/?q=*%3A*&rows=0&facet=on&facet.field=fcounty

You can apply extra keywords to: limit the results

http://localhost:8080/solr/select/?q=*%3A*&rows=0&facet=on&facet.field=fcounty&facet.limit=3

or even page the results

http://localhost:8080/solr/select/?q=*%3A*&rows=0&facet=on&facet.field=fcounty&facet.limit=5&&facet.offset=5
  

You can sort the results by number descending (Default)

http://localhost:8080/solr/select/?q=*%3A*&rows=0&facet=on&facet.field=fcounty&facet.sort=count

or alphabetical

http://localhost:8080/solr/select/?q=*%3A*&rows=0&facet=on&facet.field=fcounty&facet.sort=lex
 

You can make it so Solr only brings back facets with a minimum number of results:

http://localhost:8080/solr/select/?q=*%3A*&rows=0&facet=on&facet.field=fcounty&facet.mincount=10
  

for more information see solr wiki

Multifaceting

On a website i've worked on we used multifaceting, Solr has a bit of a clunky syntax to support this, but it works and works well.. so who cares :) Lets say I want to apply a filter (fq) on Kent as a county

http://localhost:8080/solr/select/?q=*%3A*&rows=0&facet=on&facet.field=fcounty&fq=fcounty:Kent
 

When you apply the above filter you can see that the other counties get a facet count of 0. This is single faceting and works well. To get multifaceting to work you need to tell solr to exclude the filter (fq) when it works out the facet counts. To do this you can use the ex and tag key words. When you do this you'll notice that the counts for the other facet's come back now, and the filter has still been applied to the results (numFound is still 11).

http://localhost:8080/solr/select/?q=*%3A*&version=2.2&start=0&rows=0&indent=on&facet=on&facet.field={!ex=fcounty}fcounty&fq={!tag=fcounty}fcounty:Kent
 

You can apply as many filter queries as you want now by ORing them together. So if i wanted to filter on Kent OR Cambridgeshire, you can do that as follows:

http://localhost:8080/solr/select/?q=*%3A*&version=2.2&start=0&rows=0&indent=on&facet=on&facet.field={!ex=fcounty}fcounty&fq={!tag=fcounty}fcounty:Kent%20OR%20Cambridgeshire

See how the numFound has gone up from 11 to 18

Conclusion

Now using Solr you can create a really rich user experience with searches and give ebay a run for it's money. Enjoy.

71 comments:

  1. Great! Saved me some research time on this. Especially helpful with the multifaceting.

    ReplyDelete
  2. Thanks N. Glad you liked it. Faceting is great fun.. and it's a really cool way to see what you're index looks like.

    ReplyDelete
  3. Really good Post on how to do Multifaceting with SolrNet here: http://bugsquash.blogspot.com/2010/03/low-level-solrnet.html?utm_source=feedburner&utm_medium=feed&utm_campaign=Feed%3A+bugsquash+%28Bug+squash%29

    ReplyDelete
  4. Congratulations for your post!!!

    I think it is really useful, but I have several problems to obtain a "distinct" query using faceting. I have made tests with faceting but it doesn't run correctly, I would like to know if is possible to use faceting to make a distinct in a query. Could you help me please?????

    Thank you so much.

    ReplyDelete
  5. Hi, this post of stackoverflow might help you out:

    http://stackoverflow.com/questions/2814000/how-to-select-distinct-field-values-using-solr

    ReplyDelete
  6. Yes, thank you for your reply. I had seen this post before, and later the yours but I have problems to make a distinct in solr. It doesn't run correctly using faceting. I suppose I am not doing the correct process. Like the example said, this query: //localhost:8983/solr/select/?q=*%3A*&rows=0&facet=on&facet.field=txt
    must return a query like SELECT
    DISTINCT txt
    FROM
    my_table;
    but this isn't the case, because the request to solr doesn't return the field text in any case.
    Could you help me? any suggestion is grateful.
    Thanks

    ReplyDelete
  7. I have a task of integrating solr with ofbiz. eventhough I tried many times, I am not successful. could you please guide me with steps

    ReplyDelete
  8. This is an awesome post.Really very informative and creative contents. These concept is a good way to enhance the knowledge.I like it and help me to development very well.Thank you for this brief explanation and very nice information.Well, got a good knowledge.
    Java Training in Chennai

    ReplyDelete
  9. It is amazing and wonderful to visit your site.Thanks for sharing this information,this is useful to me...
    Android Training in Chennai
    Ios Training in Chennai

    ReplyDelete
  10. Thank you for taking the time and sharing this information with us. It was indeed very helpful and insightful while being straight forward and to the point.
    mcdonalds.gutscheine | startlr.com | saludlimpia.com

    ReplyDelete
  11. Hi, Great.. Tutorial is just awesome..It is really helpful for a newbie like me.. I am a regular follower of your blog. Really very informative post you shared here. Kindly keep blogging. If anyone wants to become a .Net developer learn from Dot Net Training in Chennai. or learn thru ASP.NET Essential Training Online . Nowadays Dot Net has tons of job opportunities on various vertical industry.
    or Javascript Training in Chennai. Nowadays JavaScript has tons of job opportunities on various vertical industry.

    ReplyDelete
  12. Good post and I like it very much. By the way, anybody try this increase app downloads? I do not how to use.

    ReplyDelete
  13. Nice tutorial. Thanks for sharing the valuable information. it’s really helpful. Who want to learn this blog most helpful. Keep sharing on updated tutorials…
    python course in pune | python course in chennai | python course in Bangalore

    ReplyDelete
  14. Good Post! Thank you so much for sharing this pretty post, it was so good to read and useful to improve my knowledge as updated one, keep blogging.
    excel advanced excel training in bangalore | Devops Training in Chennai

    ReplyDelete
  15. Does your blog have a contact page? I’m having problems locating it but, I’d like to shoot you an email. I’ve got some recommendations for your blog you might be interested in hearing.


    AWS Training in Pune | Best Amazon Web Services Training in Pune

    ReplyDelete
  16. Laminated Doors manufacturer in hubli
    Thanks for giving great kind of information. So useful and practical for me. Thanks for your excellent blog, nice work keep it up thanks for sharing the knowledge.

    ReplyDelete
  17. led lawn lights in delhi
    Thanks for giving great kind of information. So useful and practical for me. Thanks for your excellent blog, nice work keep it up thanks for sharing the knowledge.

    ReplyDelete
  18. This comment has been removed by the author.

    ReplyDelete
  19. Nice blog..! I really loved reading through this article. Thanks for sharing such a amazing post with us and keep blogging...

    Article submission sites
    Education

    ReplyDelete
  20. All are saying the same thing repeatedly, but in your blog I had a chance to get some useful and unique information, I love your writing style very much, I would like to suggest your blog in my dude circle, so keep on updates.
    Java training in Chennai | Java training institute in Chennai | Java course in Chennai

    ReplyDelete
  21. It is amazing and wonderful to visit your site.Thanks for sharing this information,this is useful to me...
    Java training in Chennai

    Java training in Bangalore

    ReplyDelete
  22. Very inspiring post and very impressed to me. I want to more post related to this concept. I would you like to thanks for the grand post and keep it up...
    Ethical Hacking Course in Chennai
    Hacking Course in Chennai
    Certified Ethical Hacking Course in Chennai
    Ethical Hacking Training in Chennai
    Ethical Hacking Course

    ReplyDelete
  23. Our line by line lyrics generator is great for writing and fine-tuning songs and raps, especially when you want them to rhyme. Unlike our other song lyrics.

    ReplyDelete
  24. This is quite educational arrange. It has famous breeding about what I rarity to vouch. Colossal proverb.
    This trumpet is a famous tone to nab to troths. Congratulations on a career well achieved. This arrange is synchronous s informative impolites festivity to pity. I appreciated what you ok extremely here 


    Selenium training in bangalore
    Selenium training in Chennai
    Selenium training in Bangalore
    Selenium training in Pune
    Selenium Online training

    ReplyDelete
  25. Make your luck smile, go to the website of the online casino BGAOC and win without a hitch. good casino machine games Take the winnings constantly and without restrictions.

    ReplyDelete
  26. Nice post. Thanks for sharing! I want people to know just how good this information is in your article. It’s interesting content and Great work.
    Thanks & Regards,
    VRIT Professionals,
    No.1 Leading Web Designing Training Institute In Chennai.

    And also those who are looking for
    Web Designing Training Institute in Chennai
    SEO Training Institute in Chennai
    Photoshop Training Institute in Chennai
    PHP & Mysql Training Institute in Chennai
    Android Training Institute in Chennai

    ReplyDelete