By using listi.net you agree to our cookie policy, We and our partners operate globally and use cookies, for multiple purposes

listi.net

 


Web/Screen Scraping

Steps to know
  • Open a web page
  • Wait
  • Check that the web page is ready
  • Sign in to system
  • Sendkeys to page
  • Click the screen in a location
  • Get the Location to click
  • Copy something on the screen to the clipboard
  • Paste to a screen
  • Problems - Active window changes, website is slow

    Common process to extract web data to Excel
  • Go to the website
  • Save data to Excel
  • Copy sheet into you macro sheet
  • Process the sheet's data

    Clipboard

    You can use the clipboard to share data and automate web pages.

    During the DQ Report, I run a URL that is a Tableau web page. I preload the clipboard with a unique file name with the date. I then save the data, which opens the save dialog, and paste the file name from the clipboard.

    See Clipboard routines

    Go to a web page


    Sub GotoChangeScape()
    RunProgram "https://company.com/library"
    End sub


    MaximizeChromeLeftMonitor




    Process Click String



    Get Cursor Position




    Single Click




    Get Cursor Position
    gcp




    Create a striped table for HTML or email




    Run Program

    Declarations




    Sub



    Combine2Stories

    This code will create a link when I have stories from 2 or more epics by combining the JQL for a 2 lists of stories into one list and stop using the Hyperlink formula due to a 255-character limit

    Pseudo-code
  • The Active cell is 2nd and the cell 1 column to the left is the first
  • Extract the hyperlink from each of the cells using the ExtractLinkFromCell function

    Extract Link from Cell

    ExtractLinkFromCell



    Set a Hyperlink

    Check an external application

    Sheet



    Full Check button



    Check CRQ Status Button




    Stories Approved Button




    Story count




    GetAnchorFromCell(i, j)

    Routine is passed a row i, and column j and coverts a cell with a link to a HTML < a href > anchor tag





    CreateHTMLTableForEmail(header, nr, nc)




    Get the last modified date of a web page




    AsPlanned





    Checkifdatauploadedtogcpar



    CloseFileDownloadBar()



    CSH



    WindowKey



    Dragmouse



    GetCRQStatus



    PositionBrowserWindow



    HTML Used or output
  • < li> tag
  • < h2> tag
  • < br>
  • < p>
  • < style> or CSS - Cascading Style Sheets
  • < table>
  • < tr>
  • < td>

    Sign-in

    Many websites require a sign-in to use. You can sign in by clicking on the web page.

    For the Jira, I use a form to help with the sign-in.


    Soap



    WebQuery



    WildCardSelect



    ExtractHTMLData





    StripeAnHTMLTable



    Delay

    • 1.Wait for webpage to display
    blog comments powered by Disqus