Data – BI Practice

Data: REST API

API: Application Program Interface

A. Operation

GET: Retrieve
POST: Create
PUT: Update
DELETE: Remove

B. Formats

HTML
XML
Plain text

C. Use

Social: Twitter, Facebook
Utilities: Dropbox, Google Maps
Commerce: Stripe, Mailchimp

D. Other services

HATEOAS: Hypermedia As The Engine Of Application State
Postman: API testing
Spring Data REST

E. Application

Python: request

Data: ‘/’, ‘./’, ‘../’ Path Difference

/ is the root of the current drive;
./ is the current directory;
../ is the parent of the current directory

Reference: https://superuser.com/questions/153165/what-does-represent-while-giving-path

Data: Systematic Review Protocol

A. Get published Review Protocols from Campbell Collaboration.

On campbellcollaboration.org webpage, click “Campbell systematic Reviews journal”

The link takes you to the Wiley Online Library and you will need a library account to browse the contents. Click “Campbell Article Types”

Select “Protocol” from the list of types.

Total 248 results which can be further narrowed by selecting “Campbell subject Categories”.

B. Get published review protocols from Cochrane Reviews.

Search ‘mathematical’ in the Title Abstract Keyword and get 1 result under the Cochrance Protocols tab.

C. Layout of the Protocol

Background
- The problem, condition or issue
- Intervention
- How the intervention might work
- Why it is important to do the review
- Products of this systematic review
Objectives
Methodology
- Criteria for including and excluding studies
  - Types of study designs
  - Time and language
  - Types of participants
  - Types of interventions
  - Duration of follow-up
  - Types of settings
- Search strategy
- Search terms
- Description of methods used in primary research
- Criteria for determination of independent findings
- Details of study coding categories
- Statistical procedures and conventions
- Studies with multiple groups
- Unit of analysis issues
- investigation of heterogeneity
- Sensitivity analysis
- missing data and author queries
- Treatment of qualitative research
Reference
Review Authors
Roles and responsibilities
Funding
Potential conflict of interest
Preliminary timeframe
Author declaration

Data: Library Database Search Syntax for Systematic Review

A. Research Question:

A systematic review study is planned with the purpose of investigating whether current educational programs are effective for developing problem solving in early childhood education.

B. Terms and Definitions

Educational Programs
Problem Solving
Early Childhood

A. Reference for Systematic Review

University of Tasmania: Systematic Review for Health
Search Help for different Database

A. Library Platforms and Databases

EBSCO
- CINAHL
OVID
- MedLine
- EMBASE
- PsychINFO
ProQuest
- ERIC
- PsychINFO

Same platform has same interface, nut the subject headings are different. Same database on different platforms has the same keywords for titles and abstracts, but different heading and different truncation and proximity syntactic rules.

Data: Git Bash Installation for Windows

A. Reference: Software Carpentry Unix Shell Tutorial

B. Steps

Download git (git-2.23.0-64-bit.exe) for windows from gitforwindows.org
Install git for windows to c:\program files\git
Select Components -> Next
- Additional icons: On the Desktop
- Windows Explorer integration: Git Bash Here; Git GUI Here
- Git LFS (Large File support)
- Associate .git* configuration files with the default text editor
- Associate .sh files to be run with Bash
Choosing the default editor used by Git: Use Notepad++ as Git’s default editor -> Next
Adjusting your PATH environment: Use Git and optional Unix tools from the Command Prompt -> Next
Choosing the SSH executable: Use OpenSSH -> Next
Choosing HTTPs transport backend: Use the OpenSSL library -> Next
Configuring the line ending conversions -> Checkout Windows-style, commit Unix-style line ending -> Next
Configuring the terminal emulator to use with Git Bash: Use Windows’ default console window -> Next
Configuring extra options: Enable file system caching; Enable Git Credential Manager; -> Next -> Install
Set home environment: cmd -> cd users\username\documents ->set HOME “%USERPROFILE%” -> exit

C. Note

Windows operating system do not automatically have a Unix Shell program installed. The post shows how to install an emulator included in Git for Windows, which provides the access to both Bash shell commands as well as Git.

D. Help

Data: Export Email to Excel

Reference: https://support.office.com/en-us/article/back-up-your-email-e5845b0b-1aeb-424f-924c-aa1c33b18833

Steps:

open Outlook
Move the emails that you want to export to a folder
Go to the folder
File -> Open & Export -> Import and Export
Choose an action to perform: ->Export to a file -> Next
Create a file of type: -> Comma Separated Values
Select folder to export from: (The folder that you were in are highlighted) -> Next
Save exported file as: -> Browse -> select folder and create file name -> Next
The following actions will be performed: Export “Email messages” from folder: xxxxxxxx -> Map Custom Fields -> Finish
- Subject
- Body
- From: (Name)
- From: (Address)
- From: (Type)
- To: (Name)
- To: (Address)
- To: (Type)
- BCC: (Name)
- BCC: (Address)
- BillingInformation
- Categories
- Importance
- Mileage
- Sensitivity

Data: Curl Installation and batch download PDF files from a website

cURL Installation

download carcet.pem from https://curl.haxx.se/docs/caextract.html
download curl from https://curl.haxx.se/download.html (I use a windows system, so I download the binary file for windows 64 bit)
extract curl to c:\curl and put carcet.pem under c:\curl\bin folder
add environment variable curl with the path of curl.exe

Curl is useful for downloading files from the website. The basic command is the following:

curl -O url

This command needs be run under the c:\curl\bin folder. The files are downloaded to C:\Users\username\

Purpose: download SAS 9.3 user guide pdf files from https://support.sas.com/documentation/onlinedoc/stat/930/

In window cmd, under c:\curl\bin, run curl -o index https://support.sas.com/documentation/onlinedoc/stat/930/
- generate the index file which contains the wrapped source html code of the webpage
open git bash, run following
1. 1. cd c
  2. cd curl
  3. cd bin
  4. grep -i pdf index > list
list contains the href=”*.pdf”. Use Excel text to column to get only the name of the pdf files.
open list in notepad++ and at the bottom of the window, it shows “Windows (CR LF)”, right click and select “Unix (LF)”. This will solve the error “curl: (3) Illegal characters found in URL”
Start a new bash file in notepad++ with the following code
1. echo “Start!”
  url=https://support.sas.com/documentation/onlinedoc/stat/930/
  while read query
  do
  curl -O “$url${query}”
  echo $url${query}
  done < list
2. save as echo
in git bash, navigate to where the echo file is and run following
1. bash echo