As the Farm Hack community grows we may want to set up a verification process by which admins approve new tools given a minimum set of guidelines. At face value this idea seems at odds with the Bazaar style of Open Source development (http://en.wikipedia.org/wiki/The_Cathedral_and_the_Bazaar) but we may be able to structure this moderation mechanism in a way that does not stifle collaboration. By stifling collaboration, I mostly mean the risk of turning Moderators into bottlenecks in the community where the time it takes to approve a new Tool causes the documentation and discussion efforts to fizzle.
The best idea I've been able to come up with is using a similar model that Stack Exchange uses for new communities. Stack Exchange is a Question and Answer platform that the Stack Exchange team will duplicate on a new site for a new topic when there seems to be interest. The new community then has a time frame to prove that it will be a sustainable community as opposed to a wasteland. If the community doesn't meet certain usage metrics, then Stack Exchange deletes the site. This is my understanding of how it works anyways...
So how might we use this model? I say we continue to let anyone create a new Tool and let people see that new Tool. The catch is that if that tool doesn't reach certain documentation expectations and attention from the community, it will be deleted. For example, if someone adds a Tool, marks it as "Prototype" and a month later has no documentation talking about even a plan to start building the Tool, the Tool is deleted. That one is a no-brainer. BUT, maybe that Tool sits there abandoned for 15 days and someone else in the community starts posting questions. Other folks see those questions and they start discussing. Pretty soon people are posting Information topics for that tool and before you know it, someone summarizes all of the efforts on the Tool's Wiki page and an otherwise false starts is adopted as a community wide effort. Win!
Also, if you read between the lines, the time line creates a sense of urgency and thus momentum.