Login     Register

        Contact Us     Search


Eval Solutions

Federal educational grant reporting process is compressed from weeks to a single day running in XLeratorDB

Eval Solutions

It’s probably a rule somewhere -- when you take federal funds, you have to give something back -- usually a report. When the funds are in grants that improve math and science teaching across the state of Illinois, the reports have to be sophisticated and multi-dimensional, covering quality of professional development activities and partnerships as well as changes in teachers’ content knowledge, teachers’ instructional practices, and students’ achievement.

“I have been doing the evaluations since 2007 for this grant,” said Elizabeth Oyer, the Ph.D. statistician who is director at EvalSolutions, “and this is the first year we have done a centralized evaluation.”

The state expanded on an existing data portal, the Data Driven Instruction Portal, created through an original partnership between the Illinois Area V Learning Technology Center, EvalSolutions, and RJO Technologies. Data are collected through the portal via surveys and tests. Some data are imported into the portal. EvalSolutions provides a variety of evaluation services, and for the current project, completed cross-site meta-analyses of local evaluation results and hierarchical linear modeling to analyze local and global outcomes. Data sources are quantitative and qualitative, including achievement scores, implementation data, interviews, and extant data.

In the last wave of the grant, the state shifted the program evaluation from a local focus with different strategies, tools, and analyses to a centralized, shared evaluation framework with common assessments and processes. With 14 grants servicing about 200 school districts, 380 teachers, and 6,000 students, the state faced an analytical challenge previously completed by the participating grantees -- universities, regional offices of education and school districts.

Using XLeratorDB as part of its workflow, EvalSolutions was able to automate the analysis process for grantees, which in previous years might have spent weeks working with an external evaluator cleaning and analyzing data to prepare for the federal reporting. The more efficient centralized evaluation reduced the cost of the local evaluations and allowed for more funds to go to programming. In addition, it provides the state with more consistent evaluation across the projects. Finally, this centralized approach allows for more flexibility at the state level because EvalSolutions can provide technical support regionally rather than requiring every grant to have its own evaluator to complete this reporting process.

“We needed to add to our reporting and be able to produce an affordable solution that included statistical output based on the data going into the site, which is functionality not easily available on a site that is free to users,” said Oyer. Last June she discovered XLeratorDB from Westclintech, a SQL Server based calculation engine that has the flexibility of SQL along with the power and data security of a database.

Implementation of XLeratorDB required a few tweaks to meet the demands of the education evaluation system, but Westclintech developed them quickly.

Initially the results returned by the software for t-Test functions did not include all of the statistics (like degrees of freedom) required by education industry reporting standards, said Oyer. So she emailed the company, which launched a software improvement project that delivered what she needed in weeks.

“You can’t beat that,” she said.

In past years, getting the results in and revised was a time and resource-intensive process.

“We used to have to support and remind people throughout the spring to make sure they were getting the data, then give them a deadline to submit the report, and we had 30 days to review it and we had another process to revise it.” When there were data problems, it was months before the state evaluation team knew and often too late to respond. The centralized evaluation data collection plan provided a more consistent, timely data tracking solution for the state.

“We have to tailor the report to the federal requirements.” EvalSolutions uses Telerik software to provide bar charts and descriptive tables from a SQL database. These descriptive statistics are supplemented with the inferential statistics output provided through XLeratorDB to support interpretation of the statistical significance of changes observed in the data.

“We could have figured out how to compute it with the data tables, but then it would have been an inflexible hard-wired solution. We have to be able to spit out the results in different formats, and we could have done that with Excel and a human, but that is time and resource-intensive and doesn’t provide consistency across users.”

Now, instead of a months-long process for reporting, EvalSolutions and state evaluation team members convene one-day long regional meetings with grantees to provide on-site technical support while the grant participants complete the analysis portions of their federal reports.

“We have a structured training guide where project directors complete portions of federal report before the face-to-face session. The on-site training allows state evaluators to support the directors as needed to complete the reporting requirements. We do that once a year. We have done it once and it worked beautifully. Project directors seemed very happy with it.”

No wonder.

“If they had their own evaluators and had to clean their own data and write the results, it could take them weeks.” Many directors submitted their final reports for final state review at the end of the training that day.

For university staff who want to use the data for research, they can get it from the Data Driven Instruction Portal any way they want it such as raw data, descriptive text, raw data with actual values in text or in the pre-formatted reports that align with the federal requirements.

With a centralized data portal and EvalSolution’s analytics using XLeratorDB, completing annual federal grant reports has become more efficient and less resource-intensive.

Contact Information:
Email: eoyer@evalsolutions.com
Twitter: @elizabethoyer
Blog: http://evalsolutions.wordpress.com
Website: www.evalsolutions.com



Featured Client List

XLeratorDB has rapidly built a broad global customer base spanning more than 40 countries and 30 US states, including innovation leaders such as:


Financial Services

Government

Software/Consulting

3Point Asset Management
Access Capital Advisors
Alchemy Capital Management Pvt. Ltd.
AlixPartners LLP
Ally Bank
Alphametric Research, LLC
AEW Capital Management
Alpha Card Services
AMBIT Capital Pvt. Ltd.
American Capital
AnaCap Financial Partners LLP
Annaly Capital Management
Apollo Global Management
AutoCont SK
Avenue Capital
Axis Bank
Babson Capital Management LLC
Bain Capital
Bankers Healthcare Group, Inc.
Barclays Securities India Pvt. Ltd.
BBR Partners
Bessemer Ventures
Birla Sun Life Asset Management
Black Diamond Capital Management
BOCI-Prudential
California Republic Bank
Centerbridge Partners LP
Citigroup (IND)
Cliffwater LLC
Convergence Investment Partners
Crews & Associates, Inc.
DBI Capital Market Services Ltd
Desjardins (CAN)
Eastwood Bank
EBS Asset Management
Ellington Management
Emirates Investment Bank
Enam Securities
Entente Fund Accounting Services
Eton Advisors, LP
Fir Tree
First Gulf Bank
Fred Alger
Fusion Ventures  (case study)
GARANTI BANK SA
GEPL Capital Pvt. Ltd.
Gimv (BEL)
Golden Tree Asset Management LP
Goldman Sachs Securities India Pvt Ltd.
GRAMIT S.A.
GreatAmerica Leasing Corp
Hamilton Lane
Harbourvest Partners, LLC
Harvest Investments
Henderson Global Investors
Henninger Investments
Highland Capital
HighVista Strategies LLC
Horizon Credit Union
Hudson Advisors
Hyuandai Securities
ICICI Bank
IIFL (IND)
IndexUniverse, LLC
Infoweaver Services AB
ING Vysya bank
Jasper Ridge Partners
Javlin Capital
JM Financial Pvt. Ltd.
Karma Capital Advisor Pvt. Ltd.
Keytrade Bank
Killik & Co
Kotak Mahindra Bank Ltd.
L&T Capital Company Ltd.
Landmark Dividend LLC
Landsdowne Partners
Liberties Investments Limited
LPL Financial
Mariner Investment Group
M. B. Commercial Company Limited
Mid Atlantic Capital Group
MidAtlantic Trust
Moneta Group
Morgan Stanley
Morgan Stanley (I) Financial Services
Neue Aargauer Bank
Nilta Corp
Nordea Investment Funds S.A.
North American Savings Bank
Notz & Stucki (CHE)
PanAgora
Postbank
Prescott Securities
Prime Broking Company Ltd.(IND)
Principal PNB Asset Management
Principal Retirement Advisor Pvt.Ltd
Professional Capital Services
Profidebopt, s.r.o.
PT Otto Multiartha
MTAG Services LLC
Oak Hill Investments
Oaktree Capital
Prescott Securities (AUS)
Qatar Development Bank
RDV Corp
Republic Mortgage Home Loans
RMB (ZAF)
Samuel E Ramirez & Co.
Santandar (BEL)
Santandar Consumer Finance Benelux B.V.
SAR Capital Pvt. Ltd.
Sarasin-Alpen (India) Private Limited
Saunderson House Ltd
Savant Capital
SBAB (SWE)
The Sentient Group (AUS)  (case study)
Sequoia Heritage
Sontag Advisory
Sprism Investment Services Pvt. Ltd.
Standard Chartered (IND)
Sunrise Capital Partners
Taom Capial UK Ltd.
Titan Advisors
TPG Credit Management, LP
T. Rowe Price Associates, Inc.
Trustline Holdings
Tufton Oceanic
Turner Acceptance Corp
United Acceptance
Value Prolific Investment and Consulting
Vericrest Financial Inc
Von Braun&Schreiber (DEU)
Watts and Associates
WealthTouch
Wedbush Securites
Westdale Capital
Central Bank of Iceland
City of Toronto (CAN)
DBC Onderhoud (NLD)
Lee County Schools
NSW Cancer Institute (AUS)
PSP Investments (CAN)
Reserve Bank of Fiji
State Teachers Retirement System - Ohio
SPAWAR System Center Atlantic
US Department of the Interior
US Navy

Insurance/Healthcare

Advisory Board Company
Aegis London (GBR)
Aeolus Re (BMU)
Alterra Capital Services
Ameritas
Arch Reinsurance Ltd.
Capital & Coast District Health Board
Cathedral Underwriting Ltd
Child Health Corporation of America
Dr.Foster Intelligence
Goss Re
KaufmanHall
MetLife
Oil Insurance Ltd (BMU)
Oil Management Services
Starr Companies
XL Group
XL Insurance

Energy

Chevron
Consolidatd Edison
SPARQ Solutions Pty Ltd (AUS)
Unit Corporation

Real Estate

CapMan Oyj (FIN)
Helios AMC
iStar Financial  (case study)
Landmark Partners
London & Quadrant (GBR)
Newland Communities  (case study)
Northstar Realty Finance Corp
Townsend Group
Alpha Kinetic (GBR)
AssetLabs
Autocont SK
Bits Software
Cadis EDM (GBR)
CPACINC
Cybercom
DataAgent
Derive Technologoes
Enerpact LLC
EvalSolutions  (case study)
Farsight Consultancy Services
Ferman Automotive Management Services
Fortigent
Genpact
Hewlett Packard India Sales Pvt. Ltd.
Ingram Micro
Kenexa
Milessoft (IND)
ModelLogic
Netage Solutions
Pangea3 Legal Database Systems Pvt. Ltd.
Paylink Payment Plans
Portfolio Pathway
PSD Solutions
Rehfeld Partners A/S
Respec
SAIC
Software Guru
Sterknetwerk BV (NLD)
Supply Chain Strategy Services
Surehits
Tata Consultancy (IND)
Venture Allies
Verde International  (case study)
Via Binary

Other

BlueSun Inc.
CreditMax Auto Group
Firebrand Technologies
GRAINGER
HarperCollins Publishers
Houghton Mifflin Harcourt
The High Companies
Kemper Valve & Fittings Corp
LeahMaya Limited
Optionline
right stuff detailing
West Pak Avocado
West Valley Construction
Copyright 2008-2017 Westclintech LLC         Privacy Policy        Terms of Service