Allintitle & Golden Filter (part 2): The development of Golden Filter

<p class="p1" style="text-align: justify;">Xavier <span style="font-weight: 400;">|&nbsp; 12 mins read</span></p> <p class="p1" style="text-align: justify;">&nbsp;</p> <p class="p1" style="text-align: justify;"><span style="font-weight: 400;">In the <a href="../../../blog/allintitle-golden-filter-part-1-a-complete-guide-to-allintitle-and-every-related-question" target="_blank" rel="noopener">first part </a>of this article, we have discussed in-depth what is Allintitle and all-important questions related. To continue, let's explore further how WriterZen calculates the Golden Score Value based on that.</span></p> <h2 dir="ltr" style="text-align: justify;"><strong>Golden Score Initial Approach</strong></h2> <p dir="ltr" style="text-align: justify;">You might be familiar with our initial approach to Golden Ratio, which is calculated using the following formula:</p> <p dir="ltr" style="text-align: justify;"><span dir="ltr"><img class="fr-fic fr-dib inline-image" style="display: block; margin-left: auto; margin-right: auto;" src="../../../storage/photos/1/post-detail/Allintitle/allintitle-golden-filter-part-2-the-development-of-golden-filter-image-1.png" alt="Allintitle &amp; Golden Filter (part 2): The development of Golden Filter" width="800" height="110" data-attachment="[object Object]" data-id="69010156190"></span></p> <p dir="ltr" style="text-align: justify;"><span dir="ltr">Where Class Ratio was developed to classify values for 3 different keyword levels as follows:</span></p> <div dir="ltr" style="text-align: justify;" align="left"> <table style="width: 79.913%; height: 217.562px;"><colgroup><col style="width: 39.3151%;"><col style="width: 30.7021%;"><col style="width: 29.7161%;"></colgroup> <tbody> <tr style="height: 54.3906px;"> <td style="height: 54.3906px;"> <p dir="ltr"><strong>Class</strong></p> </td> <td style="height: 54.3906px;"> <p dir="ltr"><strong>Allintitle</strong></p> </td> <td style="height: 54.3906px;"> <p dir="ltr"><strong>Search Volume</strong></p> </td> </tr> <tr style="height: 54.3906px;"> <td style="height: 54.3906px;"> <p dir="ltr">Class 1- Top Value</p> </td> <td style="height: 54.3906px;"> <p dir="ltr">Low&nbsp;</p> </td> <td style="height: 54.3906px;"> <p dir="ltr">High</p> </td> </tr> <tr style="height: 54.3906px;"> <td style="height: 54.3906px;"> <p dir="ltr">Class 2- Medium Value</p> </td> <td style="height: 54.3906px;"> <p dir="ltr">Low&nbsp;</p> </td> <td style="height: 54.3906px;"> <p dir="ltr">Low</p> </td> </tr> <tr style="height: 54.3906px;"> <td style="height: 54.3906px;"> <p dir="ltr">Class 3- Low Value</p> </td> <td style="height: 54.3906px;"> <p dir="ltr">High</p> </td> <td style="height: 54.3906px;"> <p dir="ltr">N/A</p> </td> </tr> </tbody> </table> </div> <p dir="ltr" style="text-align: justify;">The formula was devised in a manner that even if two keywords have the same class ratio because they fall in the same class, the Allintitle value and search volume will still be able to find a comparable difference between the two. This will enable you to identify the top value keyword in each class and further helps to find the golden keyword that best fits your SEO strategy.</p> <p dir="ltr" style="text-align: justify;">But as we continued without research with the Keyword Golden Ratio, we identified several setbacks:&nbsp;</p> <ul style="list-style-type: circle; text-align: justify;"> <li dir="ltr"> <p dir="ltr">The Keyword Golden Ratio (KGR) formula does not scale very well with moderately large Allintitle values or extremely high Search Volumes. For example, a keyword with 105 Allintitle which falls into Class 3, might still be of value, in case it has an extremely high search Volume, say 4000 searches monthly.</p> </li> <li dir="ltr"> <p dir="ltr">The KGR does not distinguish or prioritize between 2 keywords that have the same Allintitle/Search Volume ratio but have different base values. For example, a keyword with 2 Allintitle/ 20 Search Volume versus a keyword with 10 Allintitle/ 100 Search Volume both share the ratio value of 0.1 but the formula doesn't tell us how the two keywords are marginally different.</p> </li> <li dir="ltr"> <p dir="ltr">The Class Ratio is intuitively quite correct, but it's not natural. New users who are not well versed with this concept, will need quite some time to understand it.</p> </li> </ul> <h2 dir="ltr" style="text-align: justify;"><strong>New Golden Filter</strong></h2> <p dir="ltr" style="text-align: justify;">Once we were confirmed that we were going in the right direction, we decided to take a more scientific approach to find out the universal formula to calculate the Golden Keyword Ratio. With the aim that this formula would be able to scale through millions of keywords successfully.&nbsp;</p> <p dir="ltr" style="text-align: justify;">Our first step in the direction would be to specify the goals, which the formula should be able to achieve:</p> <ul style="list-style-type: circle; text-align: justify;"> <li dir="ltr"> <p dir="ltr">Able to assign a specific score to all and any keywords on any given list as long as all attributes (search volume, allintitle data,..) are available.</p> </li> <li dir="ltr"> <p dir="ltr">Able to differentiate between and prioritize different groups of keywords to ensure that keywords that have higher allintitle data will also be counted as golden if they&rsquo;re compensated with exponentially higher search volume.</p> </li> <li dir="ltr"> <p dir="ltr">Introduce more ways to filter keywords for SEO requirements and research processes.</p> </li> </ul> <p dir="ltr" style="text-align: justify;">We prepared a data set with 20 million keywords from different industries, topics, search intentions, Allintitle values, Search Volumes, and other categorical attributes. Then we labeled all keywords by different difficulty and value metrics. After carefully cross-validating the labels, as well as handling outliers and removing bad data, we run the random forest classifier over different keywords buckets to find out the relationship between keyword attributes and the value of the keywords. This process involved a considerable number of complex data science concepts. It does not matter if you aren't familiar with data science, because the beauty of this filter doesn't lie in these techniques.</p> <p dir="ltr" style="text-align: justify;">We define the value of the independent variable as follow:</p> <p dir="ltr" style="text-align: justify;"><span dir="ltr"><img class="fr-fic fr-dib inline-image" style="display: block; margin-left: auto; margin-right: auto;" src="../../../storage/photos/1/post-detail/Allintitle/Keyword Golden Score.png" alt="Allintitle &amp; Golden Filter (part 2): The development of Golden Filter" width="800" height="123"></span></p> <p dir="ltr" style="text-align: justify;">Where,</p> <p dir="ltr" style="padding-left: 120px; text-align: justify;">f(AIT): Function of All-In-Title</p> <p dir="ltr" style="padding-left: 120px; text-align: justify;">f(AIT|SV): Hybrid function of Search Volume&nbsp;</p> <p dir="ltr" style="padding-left: 120px; text-align: justify;">f(SV): Function of Search Volume</p> <p dir="ltr" style="padding-left: 120px; text-align: justify;">(*) Detailed functions are not provided due to the IP sensitivity issue</p> <p dir="ltr" style="text-align: justify;">This model fits over millions of keywords to classify them into &ldquo;to be recommended &rdquo; or &ldquo;not to be recommended&rdquo; sections to find the optimal value ϕ so that,</p> <p dir="ltr" style="text-align: justify;"><img class="fr-fic fr-dii inline-image" style="display: block; margin-left: auto; margin-right: auto;" src="../../../storage/photos/1/post-detail/Allintitle/allintitle-golden-filter-part-2-the-development-of-golden-filter-image-3.png" alt="Allintitle &amp; Golden Filter (part 2): The development of Golden Filter" width="413" height="58" data-attachment="[object Object]" data-id="69010156175"></p> <p dir="ltr" style="text-align: justify;">The &Phi; value of the Random Forest Classifier Model results in 1.6176, and surprisingly, 1.6176 is very close to the famous Golden Ratio: 1.618. Golden Ratio is well known as a universal number that exists everywhere in nature from sunflower seed arrangement to human body proportions. Golden Ratio is also frequently applied in architecture, painting, physics and graphic design. We slightly round off the number 1.6176 up to 1.618. Now we have the final Golden Filter definition.</p> <p dir="ltr" style="text-align: justify;"><img class="fr-fic fr-dii inline-image" style="display: block; margin-left: auto; margin-right: auto;" src="../../../storage/photos/1/post-detail/Allintitle/allintitle-golden-filter-part-2-the-development-of-golden-filter-image-4.png" alt="Allintitle &amp; Golden Filter (part 2): The development of Golden Filter" width="426" height="62" data-attachment="[object Object]" data-id="69010156174"></p> <p dir="ltr" style="text-align: justify;">Even with complex construction, the Golden Filter works simply. The lower the Golden Keyword Score, the greater chances of that keyword being recommended and vice versa.&nbsp;</p> <p dir="ltr" style="text-align: justify;"><img class="fr-fic fr-dii inline-image" style="display: block; margin-left: auto; margin-right: auto;" src="../../../storage/photos/1/post-detail/Allintitle/allintitle-golden-filter-part-2-the-development-of-golden-filter-image-5.png" alt="Allintitle &amp; Golden Filter (part 2): The development of Golden Filter" width="800" height="210" data-attachment="[object Object]" data-id="69010156178"></p> <p dir="ltr" style="text-align: justify;">This new scoring system has an additional benefit. It will enable us to introduce another way to screen the Golden Keywords, that is by their potential value.&nbsp;</p> <p dir="ltr" style="text-align: justify;">In many of our previous videos, you must have seen how our old KGR formula worked. The formula either worked using the Allintitle number (less than 10 or 20) that represents keywords with high ranking probability in the top 10 or 20.&nbsp;</p> <p dir="ltr" style="text-align: justify;">In this new Golden Filter system, we also place a higher &ldquo;punishment attribute&rdquo; over keywords that have allintitle above 100 (meaning more than 100 competitors are trying to rank for that specific keyword). So, if there is a keyword that has allintitle data higher than 100, it will need to have a search volume of at least &nbsp;5000 - 6000 to be considered as a Golden Keyword.</p> <p dir="ltr" style="text-align: justify;">WriterZen users will now have the option of filtering their keywords in two different ways: <span dir="ltr">One&nbsp;</span>by ranking probability<span dir="ltr">&nbsp;(you can sort this by allintitle data up to 100) and the other by its potential value (using our scoring system).&nbsp;</span></p> <ul style="list-style-type: circle; text-align: justify;"> <li><span dir="ltr">The first filtering technique - <strong>by ranking probability </strong>-&nbsp;will be better suited for the users who are new to SEO and do not possess enough resources or experience in the field. All they want is to know a quick and easy way to use high-ranking keywords to boost their organic growth.&nbsp;</span></li> </ul> <p style="text-align: justify;"><img class="fr-fic fr-dib inline-image" style="display: block; margin-left: auto; margin-right: auto;" src="../../../storage/photos/1/post-detail/Allintitle/allintitle-golden-filter-part-2-the-development-of-golden-filter-image-6.png" alt="Allintitle &amp; Golden Filter (part 2): The development of Golden Filter" width="500" height="454" data-attachment="[object Object]" data-id="69010156317"></p> <ul style="list-style-type: circle; text-align: justify;"> <li><span dir="ltr">The latter filtering format&nbsp;</span>- <strong>by potential value</strong> -<span dir="ltr">&nbsp; will be fit for more experienced teams that run SEO campaigns on websites and are already well-established with rich resources and rankings. They are more or less ready to tackle more difficult keywords with higher potential and will not hesitate to invest in a long-term strategy.</span></li> </ul> <p dir="ltr" style="text-align: justify;"><span dir="ltr"><img class="fr-fic fr-dib inline-image" style="display: block; margin-left: auto; margin-right: auto;" src="../../../storage/photos/1/post-detail/Allintitle/allintitle-golden-filter-part-2-the-development-of-golden-filter-image-7.png" alt="Allintitle &amp; Golden Filter (part 2): The development of Golden Filter" width="500" height="497" data-attachment="[object Object]" data-id="69010156254"></span></p> <h2 dir="ltr" style="text-align: justify;"><strong>Use Case</strong></h2> <p dir="ltr" style="text-align: justify;">Now let us see how the new Golden keyword filter works. For this, we will be trying the keyword &ldquo;indoor snake plant&rdquo;.</p> <p dir="ltr" style="text-align: justify;"><img class="fr-fic fr-dii inline-image" style="display: block; margin-left: auto; margin-right: auto;" src="../../../storage/photos/1/post-detail/Allintitle/allintitle-golden-filter-part-2-the-development-of-golden-filter-image-8.png" alt="Allintitle &amp; Golden Filter (part 2): The development of Golden Filter" width="800" height="336" data-attachment="[object Object]" data-id="69010156177"></p> <p dir="ltr" style="text-align: justify;">The filter recommends &ldquo;different types of snake plants&rdquo; &nbsp;with 0 Allintitle value but with 720 search volume, or &ldquo;type of snake plants&rdquo; &nbsp;with only 3 Allintitle but with 6600 search volume. These keywords are extremely relevant to the original keyword but have more potential.</p> <p dir="ltr" style="text-align: justify;"><img class="fr-fic fr-dii inline-image" style="display: block; margin-left: auto; margin-right: auto;" src="../../../storage/photos/1/post-detail/Allintitle/allintitle-golden-filter-part-2-the-development-of-golden-filter-image-9.png" alt="Allintitle &amp; Golden Filter (part 2): The development of Golden Filter" width="800" height="216" data-attachment="[object Object]" data-id="69010156176"></p> <p dir="ltr" style="text-align: justify;">The keywords at the bottom of the list have a low Golden Score. They have over 200 Allintitle values like &ldquo;siam snake plant&rdquo; but with limited search volumes. This looks like a keyword you should avoid since it would be difficult to rank with, and has limited value.</p> <p dir="ltr" style="text-align: justify;"><span dir="ltr">So now that you are fully aware of how Golden Filter works, feel free to try it out by yourself. And don&rsquo;t forget to share with us how your web page ranks.&nbsp;</span></p> <p style="text-align: justify;">________________</p> <p class="p1" style="text-align: justify;"><strong>Xavier<span class="Apple-converted-space">&nbsp;</span></strong></p> <p class="p1" style="text-align: justify;">Chief Data Scientist &amp; Co-founder of WriterZen</p>