A have below html code. Need to extract text4 based on "text3" value
<div class="main">
<ul>
<li>
<div class="1"> text1 </div>
<div class="2"> text2 </div>
</li>
<li>
<div class="1"> text3</div>
<div class="2"> text4</div>
</li>
</ul></div>
I used this code, but its not working. Am I missing something or there is simpler solution for this?
a.find_next_sibling('div')[0]
for a in soup.find_all('div', text='text3')