<div dir="ltr">Hello Israel,<div><br></div><div style>I would suggest a different approach: define a format for the submissions and let the committee decide based on the contents for all complete submissions.</div><div style>

<br></div><div style>Here is a small outline of the process, which was successfully used in the AppSec Latam from 2009 to 2011:</div><div style><br></div><div style>1. define what a complete submission is. We required a form to be completed with info on the proposal, such as title, description, audience  outline, and also info on the presenter, such as past experience, published materials, etc. You can add here criteria for presentation time.</div>

<div style>2. You could vet submissions that are not related to the topic of the conference</div><div style>3. the committee grades proposals and puts out an ordered list. The criteria we used are below. Several of the items in your list are good criteria that I would use to boost the chances of a proposal being selected, but which I would not use for discarding proposals.</div>

<div style><br></div><div style>The criteria used by the committee were:</div><div style><br></div><div style><div>1. contents (weight 4)</div><div><span class="" style="white-space:pre">           </span>a. relevant to conference (weight 3)</div>

<div><span class="" style="white-space:pre">            </span>b. innovative and original (weight 2)</div><div><span class="" style="white-space:pre">              </span>c. quality of contents and presentation (weight 1)</div><div>2. author (weight 3)</div>

<div><span class="" style="white-space:pre">            </span>a. involvement in OWASP (weight 1)</div><div><span class="" style="white-space:pre">         </span>b. previous relevant contents in the field (weight 2)</div><div><span class="" style="white-space:pre">              </span>c. qualification of author(s) (weight 3)</div>

<div>3. Evaluation assessment (weight 3)</div><div><span class="" style="white-space:pre">          </span>a. reviewer familiarity with theme and confidence in his assessment (weight 3)</div><div><span class="" style="white-space:pre">             </span>b. reviewer grading (gut feeling) (weight 2)</div>

<div><br></div><div style>The form for submissions is available on the wiki: <span style="background-color:rgb(249,249,249);color:rgb(0,0,0);font-family:monospace,'Courier New';font-size:13px;line-height:1.3em"><a href="https://www.owasp.org/images/e/e4/OWASP_AppSec_Latam_2011_CFP.rtf.zip">https://www.owasp.org/images/e/e4/OWASP_AppSec_Latam_2011_CFP.rtf.zip</a></span></div>

<div style><br></div></div><div style>I can share the spreadsheet we used for tabulating the results if you want.</div><div style><br></div><div style>Regards,</div><div style><br></div><div style>Lucas</div></div><div class="gmail_extra">

<br><br><div class="gmail_quote">On Wed, Mar 6, 2013 at 11:39 AM, Israel Bryski <span dir="ltr"><<a href="mailto:israel.bryski@owasp.org" target="_blank">israel.bryski@owasp.org</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">

<div dir="ltr">Hi Leaders,<div><br></div><div>I am managing the call for papers (CFP) and call for trainers (CFT) process for the upcoming AppSecUSA in NYC (November 18, 2013). To separate the real talks from the noise during the submission process, I drafted a metric system to screen submissions. Talks receiving a minimum score of <Insert Number> will be sent to the Speaker Selection committee for review, comments and vote. The submissions that do not reach the predetermined threshold will be sent back to the author with guidance on how to improve their submission.</div>


<div><br></div><div>Here is the first draft of the metrics and I welcome your feedback, comments and criticism:</div>

<div><br></div><div><br></div><div><b style="font-size:medium;font-family:'Times New Roman';font-weight:normal"><p dir="ltr" style="text-align:justify;margin-top:0pt;margin-bottom:0pt">
<span style="font-size:24px;font-family:Calibri;background-color:transparent;font-weight:bold;vertical-align:baseline;white-space:pre-wrap">                      Criteria<span style="white-space:pre-wrap">   </span><span style="white-space:pre-wrap">        </span><span style="white-space:pre-wrap">        </span><span style="white-space:pre-wrap">        </span><span style="white-space:pre-wrap">        </span><span style="white-space:pre-wrap">        </span><span style="white-space:pre-wrap">        </span><span style="white-space:pre-wrap">        </span><span style="white-space:pre-wrap">        </span>Points</span><span style="font-size:15px;font-family:Arial;background-color:transparent;vertical-align:baseline;white-space:pre-wrap"></span></p>



<div dir="ltr"><table style="border:none;border-collapse:collapse"><colgroup><col width="471"><col width="153"></colgroup><tbody><tr style="min-height:0px"><td style="border:1px solid rgb(0,0,0);vertical-align:top;padding:7px">



<span style="font-size:15px;font-family:Calibri;background-color:transparent;vertical-align:baseline;white-space:pre-wrap">Presentation related to an active OWASP Project or activity</span></td><td style="border:1px solid rgb(0,0,0);vertical-align:top;padding:7px">



<p dir="ltr" style="text-align:center;margin-top:0pt;margin-bottom:0pt"><span style="font-size:15px;font-family:Calibri;background-color:transparent;vertical-align:baseline;white-space:pre-wrap">2 Points</span></p></td></tr>



<tr style="min-height:0px"><td style="border:1px solid rgb(0,0,0);vertical-align:top;padding:7px"><span style="font-size:15px;font-family:Calibri;background-color:transparent;vertical-align:baseline;white-space:pre-wrap">Submission includes link to recording of previous presenter performance</span></td>



<td style="border:1px solid rgb(0,0,0);vertical-align:top;padding:7px"><p dir="ltr" style="text-align:center;margin-top:0pt;margin-bottom:0pt"><span style="font-size:15px;font-family:Calibri;background-color:transparent;vertical-align:baseline;white-space:pre-wrap">2 Points</span></p>



</td></tr><tr style="min-height:0px"><td style="border:1px solid rgb(0,0,0);vertical-align:top;padding:7px"><span style="font-size:15px;font-family:Calibri;background-color:transparent;vertical-align:baseline;white-space:pre-wrap">Active volunteer for an OWASP Chapter, Global Committee or Project</span></td>



<td style="border:1px solid rgb(0,0,0);vertical-align:top;padding:7px"><p dir="ltr" style="text-align:center;margin-top:0pt;margin-bottom:0pt"><span style="font-size:15px;font-family:Calibri;background-color:transparent;vertical-align:baseline;white-space:pre-wrap">1 Point</span></p>



</td></tr><tr style="min-height:0px"><td style="border:1px solid rgb(0,0,0);vertical-align:top;padding:7px"><span style="font-size:15px;font-family:Calibri;background-color:transparent;vertical-align:baseline;white-space:pre-wrap">Presentation or training material is OWASP branded</span></td>



<td style="border:1px solid rgb(0,0,0);vertical-align:top;padding:7px"><p dir="ltr" style="text-align:center;margin-top:0pt;margin-bottom:0pt"><span style="font-size:15px;font-family:Calibri;background-color:transparent;vertical-align:baseline;white-space:pre-wrap">1 Point</span></p>



</td></tr><tr style="min-height:0px"><td style="border:1px solid rgb(0,0,0);vertical-align:top;padding:7px"><span style="font-size:15px;font-family:Calibri;background-color:transparent;vertical-align:baseline;white-space:pre-wrap">Presentation includes a live demo</span></td>



<td style="border:1px solid rgb(0,0,0);vertical-align:top;padding:7px"><p dir="ltr" style="text-align:center;margin-top:0pt;margin-bottom:0pt"><span style="font-size:15px;font-family:Calibri;background-color:transparent;vertical-align:baseline;white-space:pre-wrap">1 Point</span></p>



</td></tr><tr style="min-height:0px"><td style="border:1px solid rgb(0,0,0);vertical-align:top;padding:7px"><span style="font-size:15px;font-family:Calibri;background-color:transparent;vertical-align:baseline;white-space:pre-wrap">Defined terms or acronyms throughout presentation for the average user</span></td>



<td style="border:1px solid rgb(0,0,0);vertical-align:top;padding:7px"><p dir="ltr" style="text-align:center;margin-top:0pt;margin-bottom:0pt"><span style="font-size:15px;font-family:Calibri;background-color:transparent;vertical-align:baseline;white-space:pre-wrap">1 Point</span></p>



</td></tr><tr style="min-height:0px"><td style="border:1px solid rgb(0,0,0);vertical-align:top;padding:7px"><span style="font-size:15px;font-family:Calibri;background-color:transparent;vertical-align:baseline;white-space:pre-wrap">For Speakers: Presentation duration is 40-50 minutes</span></td>



<td style="border:1px solid rgb(0,0,0);vertical-align:top;padding:7px"><p dir="ltr" style="text-align:center;margin-top:0pt;margin-bottom:0pt"><span style="font-size:15px;font-family:Calibri;background-color:transparent;vertical-align:baseline;white-space:pre-wrap">1 Point</span></p>



</td></tr><tr style="min-height:0px"><td style="border:1px solid rgb(0,0,0);vertical-align:top;padding:7px"><span style="font-size:15px;font-family:Calibri;background-color:transparent;vertical-align:baseline;white-space:pre-wrap">For Trainers: Session will take 1 or 2 full days</span></td>



<td style="border:1px solid rgb(0,0,0);vertical-align:top;padding:7px"><p dir="ltr" style="text-align:center;margin-top:0pt;margin-bottom:0pt"><span style="font-size:15px;font-family:Calibri;background-color:transparent;vertical-align:baseline;white-space:pre-wrap">1 Point</span></p>



</td></tr><tr style="min-height:0px"><td style="border:1px solid rgb(0,0,0);vertical-align:top;padding:7px"><span style="font-size:15px;font-family:Calibri;background-color:transparent;vertical-align:baseline;white-space:pre-wrap">Previous Experience Training/Speaking</span></td>



<td style="border:1px solid rgb(0,0,0);vertical-align:top;padding:7px"><p dir="ltr" style="text-align:center;margin-top:0pt;margin-bottom:0pt"><span style="font-size:15px;font-family:Calibri;background-color:transparent;vertical-align:baseline;white-space:pre-wrap">1 Point</span></p>



</td></tr><tr style="min-height:0px"><td style="border:1px solid rgb(0,0,0);vertical-align:top;padding:7px"><span style="font-size:15px;font-family:Calibri;background-color:transparent;vertical-align:baseline;white-space:pre-wrap">Complete Abstract</span></td>



<td style="border:1px solid rgb(0,0,0);vertical-align:top;padding:7px"><p dir="ltr" style="text-align:center;margin-top:0pt;margin-bottom:0pt"><span style="font-size:15px;font-family:Calibri;background-color:transparent;vertical-align:baseline;white-space:pre-wrap">1 Point</span></p>



</td></tr><tr style="min-height:0px"><td style="border:1px solid rgb(0,0,0);vertical-align:top;padding:7px"><Insert Your Metric Here></td><td style="border:1px solid rgb(0,0,0);vertical-align:top;padding:7px"><br></td>


</tr></tbody></table></div></b></div><div><br></div><div>Thanks,</div><div>Israel</div></div>
<br>_______________________________________________<br>
OWASP-Leaders mailing list<br>
<a href="mailto:OWASP-Leaders@lists.owasp.org">OWASP-Leaders@lists.owasp.org</a><br>
<a href="https://lists.owasp.org/mailman/listinfo/owasp-leaders" target="_blank">https://lists.owasp.org/mailman/listinfo/owasp-leaders</a><br>
<br></blockquote></div><br><br clear="all"><div><br></div>-- <br>Homo sapiens non urinat in ventum.
</div>