Friday, October 15, 2010

TreeRipper: towards a fully automated optical tree recognition software

Unfortunately my TreeRipper program has been rejected from BMC bioinformatics for now because there are too many delegate programs that the reviewers didn't manage to install successfully. So until I manage to find time to make a makefile that can deal with the installation on multiple platforms, I have put the manuscript on Nature precedings and you can find the code at google code. I think I am the first to attempt to fully automate the conversion of a tree image into something more useful for researchers and I hope that what I have done can be built upon and improved. I have attached to the code a set of images and tree files that might be useful for training and/or benchmarking future programs.
Enhanced by Zemanta

Wednesday, September 01, 2010

2nd UK RAD Sequencing Meeting: wrap-up #RADseq

Males in breeding colors of the three spined s...Image via WikipediaThe 2nd UK RAD sequencing meeting took place at the e-Science institute in Edinburgh. John Davey did a brilliant job of organizing the event and the e-Science is always a good venue for meetings and workshops.
The meeting was split into the morning session were we heard from the developers of RAD-sequencing and useful bioinformatic tools from John Davey: RADtools.
Dr William Cresko (Oregon) talked about the history of RAD tags and some recent applications in their lab which mainly center around understanding phenotypic evolution in the non-model three spined stickleback.
Dr Susan Bassham (Oregon) brought up quite a few practical issues on the molecular side of things. One that stuck to mind, is that it is much better to use restriction enzymes that will result in similar fragment sizes and smaller fragments are better so that the intensity of the dots on the Illumina cell are similar. Ideally, the GC content of your samples that you are planning to mix, should have similar GC-content, so mixing different species is probably not recommended.

Dr Paul Hohenlohe (Oregon) talked about cleaning up the data after sequencing. How to detect sampling biases: different tags, different alleles and sequencing errors. Other sources of error include PCR variance, polymorphisms at the RAD sites. All these need to be accounted for in the analyses. He has developed a maximum likelihood genotyping based on multinomial distribution of the reads. The sequencing error parameter is estimated independently for each site. His most recent paper goes into further detail.

Dr Simon Baxter (Cambridge) is using RAD-tags for gene discovery and linkage mapping in the Diamond-back moth. He is mainly interested in the evolution of resistance to pesticides.

Dr Maureen Liu (Nottingham) is using RAD-tag to determine the genetic mechanism for Left-Right chirality in the pond snail. Out of the 70,000 RAD-tags she got from cutting the 1.4Gb genome with the restriction enzyme SbfI, she found a subset of 19 that were linked to chirality. She also managed to link it to a specific gene but kept the name of the gene hush hush.

Dr Shapiro and Dr Justin Gerke (Princeton) used RAD-tag for a global survey of C. elegans. They found that some strains share nothing, others share everything but most share about 40% of their genome and 94% of the strain pairs analysed share one fragment. The fragments shared are also large. They suggest that this may be due to recent migration but selection, both background selection and positive sweep, may also play a role.

The remaining afternoon talks were about projects that were getting started and it was a good opportunity for the speakers to receive advice from the guys who had already used RAD-tag.
  • Developing RAD markers as a resource for plant breeding using the perennial ryegrass Lolium perenne. Dr Matt Hegarty (Aberystwyth)
  • Unearthing the functionally relevant genetic diversity from the earthworm
    genome. Dr Pete Kille (Cardiff)
  • Exploring the use of RAD markers in tree breeding programmes. Dr Pablo Fuentes Utrilla (Edinburgh)
  • RAD Sequencing for applied conservation genetics. Dr Rob Ogden (TRACE Network, Edinburgh)
  • Adaptive significance and genetic basis of a balanced colour-
    polymorphism in Philaenus spumarius. Dr Octavio Paulo (Lisbon)
  • RAD genetic mapping of reproductive mode in tadpole shrimps. Tom Mathers (Hull)
  • The genetic architecture of a fundamental social trait. Dr Yannick Wurm (Lausanne)

All the talks were very honest about the difficulties of the approach. I really got the feeling that the community was working together to improve the technique and advise researchers on how to use the method.

Update: The talks are now available here.
Enhanced by Zemanta

Thursday, August 26, 2010

Google Voice, Skype or TalkTalk

Mexican Flag in the 19th centuryImage via WikipediaThis morning, when I logged into my Google account, I got a little pop-up ad saying that I had $0.1 Google Voice credit. Prices seem cheap and I want to see whether it will be worth me using GoogleVoice instead of Skype for my calls. I have already posted a comparison of VoipCheap, Skype and Gizmo here. It looks like Google have set themselves up in direct competition with Skype so I am going to try to work out when I would be better off using GoogleVoice.
We tend to call friends and family in Mexico, France, Norway and occasionally Spain.













Prices in pence per min incl. VAT
Table
GoogleVoice
SkypeOut*
Mexico (Landline)6.56.4
Mexico (Mobile)1220.7
Mexico-Guadalajara (Landline)1.32.1
Mexico-Mexico City (Landline)1.31.4
Mexico-Mexico City (Mobile)12 ?20.7 ?
Mexico-Monterrey (Landline)1.31.4
France (Landline)1.31.4
France (Mobile)9.713.2
norway (Landline)1.31.4
norway (Mobile)1313.8
spain (Landline)1.31.4
spain (Mobile)1217.7

There's very little in it when comparing calls to landlines but Google Voice does seem to be cheaper when calling mobiles. I will check sound quality but unless it is way better than Skype, I will stick with the devil I know.
Enhanced by Zemanta

Friday, August 06, 2010

Getting Evernote to OCR for you

Evernote is a great app that lets you make notes, take photos and screenshots, bookmark webpage and syncs everything so that you can access it from any computer, iphone or ipad. What I love about it, is that when you take a screen shot, it uploads the image to its server and tries to OCR the text, even hand-written text. Although technically speaking, Evernote doesn't actually do OCR:
"Evernote's image processing technology is a bit different. We analyze the image to generate a set of possibilities for each word that we see in an image. Each possible interpretation is given a score.
For example, we may look at a word and decide that this word may either be "clue" or "due", and we can assign a score to each possibility. This set of scored possibilities is stored in our database for searching.

As a result, there isn't a simple text representation that you can use. Instead, you can search our database to find the image based on the different sets of possible interpretations for each word."

Well, there is a way to get to that OCRed text (or data interpretation). You can find it in the files in Metadata/com.evernote.Evernote. Just in case anybody was wondering.
Enhanced by Zemanta

Thursday, June 03, 2010

The long short communication of M. Stift

Marc Stift also know as Stifty by some, has recently left Glasgow for the sunnier climate of Portugal. Just this week, the (not so short) short communication that he worked on tirelessly, has been published. I kept on trying to convince him that it was important that people understood the statistics of small sample size and that he should include the simulation graphs that he generated for determining the statistical power when determining the inheritance in tetraploids (but he ignored me). This is probably for the best as the figures would probably just have lingered in the depths of the supplementary materials. I am still working on convincing him to release those figures which might end up in his first blog or in a second paper. I'll keep you informed!

Monday, May 31, 2010

Increasingly wondering what publishers do for science and research

It seems that researchers are increasingly using Open Acesss (OA) platforms like Arxiv or Nature Precedings to disseminate their work. Authors often submit their pre-print manuscript version to these sites or to in-house depositories, for example Enlighten at the University of Glasgow. Researchers are at least encouraged to do this by funding bodies and research institutions.
This often means that the article is in circulation before the publisher's nicely formatted version (see for example, Rod's Elsevier Grand Challenge Paper) and begs the question "What do the publishers do for research and the scientific process?".
Ten years ago, it was easy to see the role that publishers had, they disseminated your work by convincing libraries and individuals to subscribe to their journals. In this way, your research had a chance to be seen on a few library shelves across the world after a few months of format checking and page layout with the publisher. But now, the worldwide web does that for you and does it immediately!
O.K., publishers do play an important role in the review process. They make sure they get a famous and qualified editorial board who select good papers for review and choose good reviewers for the job. This increases the impact of the journal and so feeds back into the status of the journal and the publishers. But increasingly, this seems to be the only thing that publishers are providing and could be done by other institutions like universities.
It seems that publishers have caught onto the fact that things are changing fast and they need to do something about it. One solution is to enrich the readers experience of a paper if he reads it on the publishers website as opposed to the pre-print pdf version in these OA archives. This, I think, was the idea behind the Elsevier Grand Challenge and perhaps behind the PLoS Hub for Biodiversity . There is no doubt that we are in need of better ways of finding research and data with the ever increasing number of publications to keep up with.

Wednesday, April 21, 2010

A way to improve the commenting system on publications

I was chatting to Rod a few days ago about his visit to CalAcademy for a Plos markup meeting and our disucssion strayed onto the commenting system of publications like Plos and the Biomed Central Journals. I was saying to him that I had left a few comments both as an individual and as a member of the molecular ecology discussion group in the department (not that I can remember the journal or the narture of the comments anymore) and that I had never received a response or feedback from the authors of the manuscript. Additionally, it isn't possible for me to get a list of the comments that I have left. Rod suggested that really what these sites needed was a way
to credit readers and commentors of the articles in a similar way to Disqus. Disqus is great, because all the comments you make on a range of different blogs and sites can all be accessed at Disqus, you can manage them yourself, edit them and delete them. You are in control of what
you have written. You can also see all the responses to your comments. Additionally, you get credits from fellow commentors for the comments and ideas that you put forward. It would be great if you could have the same level of control over the comments you leave on manuscripts at Plos and Biomed Central.
So I wrote a quick email to the guys over at Biomed Central:

Hi,
I was wondering whether there was a central page I could go to,
to see the comments I have left on manuscripts along with the responses to
those comments. If this doesn't exist, I think it should. Creating a system
of commenting like disqus might encourage more people to comment on articles.
It enables the commentor to keep track of their comments, receive feedback, get rated and thus gives an incentive to comment. You could just enable disqus on your site.

Kind regards,
Joseph Hughes


I got this in reply:

Dear Joseph Hughes
Thank you for contacting BioMed Central.
Readers' Comments are available to view on the right-hand menu of all published articles:
The link below will take you to an example article where a comment has been left, you can access the article by clicking the associated link in the right-hand menu:
http://www.biomedcentral.com/1471-2105/10/2
If you have any questions please don't hesitate to contact me.

Best wishes
David Roman


Either I was unclear or they just don't get it! In any case, I am very pessimistic about the system of commenting getting any better in the near future.

Reblog this post [with Zemanta]

Friday, February 05, 2010

The people behind the paper

I thought it might be interesting for readers to hear about how our recent paper came together and especially who the people are behind the names. A while back, samples of Halipeurus lice landed on Rod Page's desk. As a postdoc in his lab, I was charged with storing them in the freezer and entering the relevant data in the now defunct lousebase, although the data is now available on Google Docs.
Ruth Brown, a PhD student at the time working at the Zoological Institute London, had sent the samples, suggesting that it would be interesting to sequence them. The specimen came from the Trindade petrel (Pterodroma arminjoniana) on Round Island (near Mauritius) where she had been working for her thesis. The presence of this petrel on Round Island was probably a recent colonisation as there were no records of the petrel on the island prior to the 1960s.
I did not realize why it would be interesting to do this sequencing until I met Leandro Bugoni from Brazil. He was just finishing his PhD at the University of Glasgow with Bob Furness. He had been working on the Trindade petrel on Trindade Island (near Brazil). Interestingly, they had found little difference between these two island bird populations whether it was based on genetic markers, morphology or calls and yet they hosted different lice species.
We knew this thanks to the expert identification skills of Ricardo Palma based at the Museum of New Zealand Te Papa Tongarewa and whom I had collaborated with before on Pectinopygus lice on pelicans.
What we did not know, was how these two lice species were related, how divergent they were and their origin. Had they always been associated with the Trindade Petrel? Had they recently parasitized one of the bird populations?
Fortunately, a friendly Faroese MRes student, Sjudur Hammer, chose my suggested project proposal and did all the lab work. He copped very well in the lab and managed to get some good quality sequences for the Halipeurus lice from both islands.
And voila! We published what I think is a cool cospeciation study of lice and gadfly petrels and it was a pleasure to collaborate with such an international group of researchers.

Thursday, February 04, 2010

Image searching

I have been trying to find images on the web that will match images that I upload and I have come across a few cool websites.
To start with there is pixolu. Although it doesn't enable you to upload an image, it lets you search for particular key words and then select the types of images that you would like. Using these images, it then refines the search to find images similar to those that you have selected. I thought it was a very nifty tool. This is quite similar to Google Similar Image, except that it has a nicer interface and a lot of images in the Google Similar don't actually have a similar even though the same image in pixolu does.
Then there is retrievr which still doesn't let you upload an image but you can squiggle something in a box an it will find similar images on the web. I was impressed to find that when I did a very rough drawing of a tulip, the search did pull up an image of a tulip (see the screenshot).

But something like Gazopa was what I was really looking for. Unfortunately, it doesn't work as well as I would hope. Even though the image I upload is available on Flickr, it doesn't actually find it. It does do a good job at finding images with similar colours (see screenshot).

Thursday, January 14, 2010

Species Image ReCAPTCHA

After seeing the inspiring talk of Luis von Ahn on PopTech, I was thinking that CAPTCHA (Completely Automated Public Turing test to tell Computers and Humans Apart) could be a cool way to improve the OCR of species names in books OCRed by the Biodiversity Heritage Library particularly as Rod is currently using ReCAPTCHA on BioStor. BioStor is helping to annotate and extract data from BHL and Rod is using ReCAPTCHA to check that the annotation is being made by a human.
In my limited experience of OCRing, I have found that italicized species names are particularly hard to get right, so if ReCAPTCHA could be set-up to to use species names from BHL, then users annotating BioStor would be improving the OCRing of BHL articles and helping to annotate it.
Along the same lines, I have been thinking that it would be great if you could use the power of the brain to annotate species images that are on the web, a bit in the style of Google's Image Labeler which I find addictive so have been avoiding it for a while. Then quite by chance, I came across this image CAPTCHA at the University of Edinburgh.
I thought this would be a really cool way to help tag wildlife images at least using common names. You could also do a pro version for taxonomists with latin binomial tagging.

Thursday, December 24, 2009

Wednesday, December 09, 2009

Motion Chart of NCBI data


The last decade has seen a huge increase in sequence data in public databases with an impressive increase in species coverage. Here, I have used Google's Motion Chart API and Google spreadsheet do illustrate the changes in numbers of sequences and numbers of species for different taxonomic groups. Whilst the nucleotide sequence increase against the number of species sequenced has been exponential for all taxonomic groups, the rate of increase in nucleotide sequences per species appears to have accelerated since 2007 for Fungi and Bacteria. The gap also seems to be widening between the number of nucleotides per species in the Metazoa compared the Viridiplantae. There appears to be no signs of a plateau and with the next-generation sequencers, we are likely to soon see an even sharper increase in the number of nucleotides per species. However, I suspect the rate at which additional species are added to NCBI might begin to slow as we find it harder to collect and sample novel species.

Tuesday, November 10, 2009

Berlin's eco-damaging styrofoam wall of dominoes

It is rather disappointing that the Germans decided to celebrate 20 years since the fall of the wall by generating 1000 styrofoam dominoes. Styrofoam is one of the most ecologically damaging materials we create. Where are all the blocks going to go now? Probably into a land fill and take hundreds of years to degrade. It is surprising that a normally environmentally conscious country like Germany would not think of such issues.
They could have gone for something more environmentally friendly.

PopTech's Video feed VIDEO RSS PopTech's Blog feed BLOG RSS

Tuesday, November 03, 2009

Which digital photo printing is best?

Following a previous blog and EditGrid spreadsheet, I got a comment about not including a quality comparison. Well Jon on the Gadget show has now done the job on 13 different companies. Colorama was a definite no no because the photos were all very faded.
Jessops got excluded but I missed the justification for it. OneView was the best but the most expensive at 73p per photo. So Jon chose Snapfish as the favorite because of quality and price.

Friday, October 23, 2009

Why I think a Phylogenetic Standard might not work

Currently we have many different formats for phylogenies (e.g., nexus, newick, extend newick, phylip, xml) and there is no doubt that putting in place a Phylogenetic Standard would be a good thing but just because a group of researchers get together and decide that a Phylogenetic Standard would be good doesn't make it happen. Unless the phylogenetic community is behind the decisions being made which is unlikely to happen any time soon as phylogeneticist already have a poor record of submitting their phylogenies to databases like TreeBase.
These are obviously points that you are aware of as you mention them in your statement. I only remark that unless publishers enforce a particular format and submission of the phylogenetic data into repositories (like GenBank/EMBL), then however noble the idea of a Phylogenetic Standard is, it is unlikely to be put into practice by phylogeneticists.

Installing DBD::mysql on MacosX 10.5

I was having real trouble installing DBD::mysql on my iMac (version 10.5.8) until I found this. So I updated my version of Mysql to Mac OS X 10.5 (PowerPC, 32-bit) from here following the instructions for updating from Marc Liyanage. And finally, it all worked. Thank you Marc Liyanage.

Wednesday, October 21, 2009

Pulling up text sections across multiple documents using searches and filters

Came across A.nnotate.com whilst reading the comments here. In A.nnotate.com you can
search and browse the text, tags and notes
any part of the text can be annotated or even regions of an image
In the tools section, you can get an index of all the tags and you can also get a text file with the notes taken.
Unfortunately it is not free so I have only played with the example files and I am not sure my links will work but I thought it could be really good tool to integrate into BHL, GoogleBooks and Mendeley for example as it has the ability to pull up text sections across multiple documents using searches and tags so collaborators can mark-up pdfs and share their tags and notes.

Friday, October 16, 2009

Tuesday, October 13, 2009

Wordle of keywords

I have been monitoring my blog with google analytics for a couple of weeks and wanted to see what the main keywords were that had resulted in a hit on the blog.
Wordle: keyword search
It seems like a number of people have been looking for a iphone app that identifies bird songs. I wrote a while back a blog suggesting that a version of Shazam that had bird songs included would be really useful but as it turns out Shazaam doesn't really work that well when you have a lot of background noise which is likely to be the case when trying to identify birds from their songs in the wild. I will keep my eyes open for such an app as it seems a lot of you are interested. Likewise, if you here about anything, please leave a comment here.

Monday, October 12, 2009

Zotero linked into Mendeley

Downloaded Mendeley 0.9.4 and now you can import all the references from Zotero. I didn't have too many refs in Zotero (844) so it didn't take too long to import them. After a couple of crashes, it now seems to work fine. I couldn't figure out how to import the pdf links unfortunately. I think this might be quite useful, especially as Zotero is so much better at importing the metadata.

Disqus for Evo-Karma